2023-07-15 21:10:44,786 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestExportSnapshot timeout: 13 mins 2023-07-15 21:10:45,044 DEBUG [main] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/de3e87f0-08fc-c0d0-c969-4c410fd4e6fd 2023-07-15 21:10:45,044 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestMobExportSnapshot timeout: 13 mins 2023-07-15 21:10:45,045 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestMobSecureExportSnapshot timeout: 13 mins 2023-07-15 21:10:45,086 WARN [Time-limited test] util.NativeCodeLoader(62): Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 2023-07-15 21:10:45,356 INFO [Time-limited test] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=3, rsPorts=, rsClass=null, numDataNodes=3, dataNodeHosts=null, numZkServers=1, createRootDir=false, createWALDir=false} 2023-07-15 21:10:45,357 INFO [Time-limited test] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/de3e87f0-08fc-c0d0-c969-4c410fd4e6fd/cluster_474a310c-7bd1-3ce2-91d1-9793d9692166, deleteOnExit=true 2023-07-15 21:10:45,357 INFO [Time-limited test] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-07-15 21:10:45,358 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/de3e87f0-08fc-c0d0-c969-4c410fd4e6fd/test.cache.data in system properties and HBase conf 2023-07-15 21:10:45,359 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/de3e87f0-08fc-c0d0-c969-4c410fd4e6fd/hadoop.tmp.dir in system properties and HBase conf 2023-07-15 21:10:45,359 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/de3e87f0-08fc-c0d0-c969-4c410fd4e6fd/hadoop.log.dir in system properties and HBase conf 2023-07-15 21:10:45,360 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/de3e87f0-08fc-c0d0-c969-4c410fd4e6fd/mapreduce.cluster.local.dir in system properties and HBase conf 2023-07-15 21:10:45,360 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/de3e87f0-08fc-c0d0-c969-4c410fd4e6fd/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-07-15 21:10:45,360 INFO [Time-limited test] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-07-15 21:10:45,719 DEBUG [Time-limited test] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-07-15 21:10:45,724 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/de3e87f0-08fc-c0d0-c969-4c410fd4e6fd/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-07-15 21:10:45,725 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/de3e87f0-08fc-c0d0-c969-4c410fd4e6fd/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-07-15 21:10:45,725 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/de3e87f0-08fc-c0d0-c969-4c410fd4e6fd/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-07-15 21:10:45,726 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/de3e87f0-08fc-c0d0-c969-4c410fd4e6fd/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-15 21:10:45,726 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/de3e87f0-08fc-c0d0-c969-4c410fd4e6fd/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-07-15 21:10:45,727 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/de3e87f0-08fc-c0d0-c969-4c410fd4e6fd/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-07-15 21:10:45,727 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/de3e87f0-08fc-c0d0-c969-4c410fd4e6fd/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-15 21:10:45,728 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/de3e87f0-08fc-c0d0-c969-4c410fd4e6fd/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-15 21:10:45,728 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/de3e87f0-08fc-c0d0-c969-4c410fd4e6fd/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-07-15 21:10:45,728 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/de3e87f0-08fc-c0d0-c969-4c410fd4e6fd/nfs.dump.dir in system properties and HBase conf 2023-07-15 21:10:45,729 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/de3e87f0-08fc-c0d0-c969-4c410fd4e6fd/java.io.tmpdir in system properties and HBase conf 2023-07-15 21:10:45,729 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/de3e87f0-08fc-c0d0-c969-4c410fd4e6fd/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-15 21:10:45,730 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/de3e87f0-08fc-c0d0-c969-4c410fd4e6fd/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-07-15 21:10:45,730 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/de3e87f0-08fc-c0d0-c969-4c410fd4e6fd/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-07-15 21:10:46,321 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-07-15 21:10:46,325 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-07-15 21:10:46,599 WARN [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties 2023-07-15 21:10:46,777 INFO [Time-limited test] log.Slf4jLog(67): Logging to org.slf4j.impl.Reload4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog 2023-07-15 21:10:46,794 WARN [Time-limited test] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-15 21:10:46,832 INFO [Time-limited test] log.Slf4jLog(67): jetty-6.1.26 2023-07-15 21:10:46,871 INFO [Time-limited test] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/de3e87f0-08fc-c0d0-c969-4c410fd4e6fd/java.io.tmpdir/Jetty_localhost_36383_hdfs____.jx63v/webapp 2023-07-15 21:10:47,017 INFO [Time-limited test] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:36383 2023-07-15 21:10:47,061 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-07-15 21:10:47,061 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-07-15 21:10:47,661 WARN [Listener at localhost/46859] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-15 21:10:47,751 WARN [Listener at localhost/46859] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-07-15 21:10:47,799 WARN [Listener at localhost/46859] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-15 21:10:47,807 INFO [Listener at localhost/46859] log.Slf4jLog(67): jetty-6.1.26 2023-07-15 21:10:47,820 INFO [Listener at localhost/46859] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/de3e87f0-08fc-c0d0-c969-4c410fd4e6fd/java.io.tmpdir/Jetty_localhost_45025_datanode____yxfsp/webapp 2023-07-15 21:10:47,966 INFO [Listener at localhost/46859] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:45025 2023-07-15 21:10:48,491 WARN [Listener at localhost/39833] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-15 21:10:48,541 WARN [Listener at localhost/39833] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-07-15 21:10:48,545 WARN [Listener at localhost/39833] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-15 21:10:48,547 INFO [Listener at localhost/39833] log.Slf4jLog(67): jetty-6.1.26 2023-07-15 21:10:48,557 INFO [Listener at localhost/39833] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/de3e87f0-08fc-c0d0-c969-4c410fd4e6fd/java.io.tmpdir/Jetty_localhost_45947_datanode____.e5r5tq/webapp 2023-07-15 21:10:48,718 INFO [Listener at localhost/39833] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:45947 2023-07-15 21:10:48,734 WARN [Listener at localhost/38465] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-15 21:10:48,791 WARN [Listener at localhost/38465] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-07-15 21:10:48,796 WARN [Listener at localhost/38465] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-15 21:10:48,798 INFO [Listener at localhost/38465] log.Slf4jLog(67): jetty-6.1.26 2023-07-15 21:10:48,817 INFO [Listener at localhost/38465] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/de3e87f0-08fc-c0d0-c969-4c410fd4e6fd/java.io.tmpdir/Jetty_localhost_42105_datanode____.32r8m9/webapp 2023-07-15 21:10:48,979 INFO [Listener at localhost/38465] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:42105 2023-07-15 21:10:49,005 WARN [Listener at localhost/43845] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-15 21:10:49,223 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xdb7bfd61583e77fb: Processing first storage report for DS-5cb6e29a-c48c-47ff-96ae-dc7e6eca3f9b from datanode 2125fe86-fd52-4188-8e68-af930ffa0d07 2023-07-15 21:10:49,225 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xdb7bfd61583e77fb: from storage DS-5cb6e29a-c48c-47ff-96ae-dc7e6eca3f9b node DatanodeRegistration(127.0.0.1:35451, datanodeUuid=2125fe86-fd52-4188-8e68-af930ffa0d07, infoPort=39103, infoSecurePort=0, ipcPort=43845, storageInfo=lv=-57;cid=testClusterID;nsid=1981244881;c=1689455446394), blocks: 0, hasStaleStorage: true, processing time: 2 msecs, invalidatedBlocks: 0 2023-07-15 21:10:49,226 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x962151e9b2af9c2a: Processing first storage report for DS-cf2d8e8b-b29a-4800-acc6-92478c73ef7d from datanode 7bdc9da6-4d84-4f74-bf3b-c2a5911c3198 2023-07-15 21:10:49,226 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x962151e9b2af9c2a: from storage DS-cf2d8e8b-b29a-4800-acc6-92478c73ef7d node DatanodeRegistration(127.0.0.1:46855, datanodeUuid=7bdc9da6-4d84-4f74-bf3b-c2a5911c3198, infoPort=46155, infoSecurePort=0, ipcPort=39833, storageInfo=lv=-57;cid=testClusterID;nsid=1981244881;c=1689455446394), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-15 21:10:49,226 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xb8f004431b0b8c66: Processing first storage report for DS-82af0571-8e40-4ba5-976e-f28b55eb8f8c from datanode 73d69783-f50d-42d1-a709-10d2077ced75 2023-07-15 21:10:49,226 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xb8f004431b0b8c66: from storage DS-82af0571-8e40-4ba5-976e-f28b55eb8f8c node DatanodeRegistration(127.0.0.1:40117, datanodeUuid=73d69783-f50d-42d1-a709-10d2077ced75, infoPort=45753, infoSecurePort=0, ipcPort=38465, storageInfo=lv=-57;cid=testClusterID;nsid=1981244881;c=1689455446394), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-15 21:10:49,227 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xdb7bfd61583e77fb: Processing first storage report for DS-5cb4cfc6-ca65-47eb-bce8-b3f1365f62a6 from datanode 2125fe86-fd52-4188-8e68-af930ffa0d07 2023-07-15 21:10:49,227 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xdb7bfd61583e77fb: from storage DS-5cb4cfc6-ca65-47eb-bce8-b3f1365f62a6 node DatanodeRegistration(127.0.0.1:35451, datanodeUuid=2125fe86-fd52-4188-8e68-af930ffa0d07, infoPort=39103, infoSecurePort=0, ipcPort=43845, storageInfo=lv=-57;cid=testClusterID;nsid=1981244881;c=1689455446394), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-15 21:10:49,227 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x962151e9b2af9c2a: Processing first storage report for DS-7b5a8b26-add2-483e-950e-730a446064c0 from datanode 7bdc9da6-4d84-4f74-bf3b-c2a5911c3198 2023-07-15 21:10:49,227 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x962151e9b2af9c2a: from storage DS-7b5a8b26-add2-483e-950e-730a446064c0 node DatanodeRegistration(127.0.0.1:46855, datanodeUuid=7bdc9da6-4d84-4f74-bf3b-c2a5911c3198, infoPort=46155, infoSecurePort=0, ipcPort=39833, storageInfo=lv=-57;cid=testClusterID;nsid=1981244881;c=1689455446394), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-15 21:10:49,227 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xb8f004431b0b8c66: Processing first storage report for DS-c2d8950d-e881-4274-975c-6a7e2e6c6fcc from datanode 73d69783-f50d-42d1-a709-10d2077ced75 2023-07-15 21:10:49,227 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xb8f004431b0b8c66: from storage DS-c2d8950d-e881-4274-975c-6a7e2e6c6fcc node DatanodeRegistration(127.0.0.1:40117, datanodeUuid=73d69783-f50d-42d1-a709-10d2077ced75, infoPort=45753, infoSecurePort=0, ipcPort=38465, storageInfo=lv=-57;cid=testClusterID;nsid=1981244881;c=1689455446394), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-15 21:10:49,453 DEBUG [Listener at localhost/43845] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/de3e87f0-08fc-c0d0-c969-4c410fd4e6fd 2023-07-15 21:10:49,554 INFO [Listener at localhost/43845] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/de3e87f0-08fc-c0d0-c969-4c410fd4e6fd/cluster_474a310c-7bd1-3ce2-91d1-9793d9692166/zookeeper_0, clientPort=50024, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/de3e87f0-08fc-c0d0-c969-4c410fd4e6fd/cluster_474a310c-7bd1-3ce2-91d1-9793d9692166/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/de3e87f0-08fc-c0d0-c969-4c410fd4e6fd/cluster_474a310c-7bd1-3ce2-91d1-9793d9692166/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-07-15 21:10:49,583 INFO [Listener at localhost/43845] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=50024 2023-07-15 21:10:49,603 INFO [Listener at localhost/43845] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-15 21:10:49,606 INFO [Listener at localhost/43845] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-15 21:10:50,301 INFO [Listener at localhost/43845] util.FSUtils(471): Created version file at hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313 with version=8 2023-07-15 21:10:50,301 INFO [Listener at localhost/43845] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/hbase-staging 2023-07-15 21:10:50,681 INFO [Listener at localhost/43845] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl 2023-07-15 21:10:51,251 INFO [Listener at localhost/43845] client.ConnectionUtils(127): master/jenkins-hbase4:0 server-side Connection retries=45 2023-07-15 21:10:51,289 INFO [Listener at localhost/43845] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-15 21:10:51,289 INFO [Listener at localhost/43845] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-15 21:10:51,289 INFO [Listener at localhost/43845] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-15 21:10:51,290 INFO [Listener at localhost/43845] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-15 21:10:51,290 INFO [Listener at localhost/43845] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-15 21:10:51,460 INFO [Listener at localhost/43845] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-07-15 21:10:51,541 DEBUG [Listener at localhost/43845] util.ClassSize(228): Using Unsafe to estimate memory layout 2023-07-15 21:10:51,645 INFO [Listener at localhost/43845] ipc.NettyRpcServer(120): Bind to /172.31.14.131:36465 2023-07-15 21:10:51,664 INFO [Listener at localhost/43845] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-15 21:10:51,667 INFO [Listener at localhost/43845] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-15 21:10:51,698 INFO [Listener at localhost/43845] zookeeper.RecoverableZooKeeper(93): Process identifier=master:36465 connecting to ZooKeeper ensemble=127.0.0.1:50024 2023-07-15 21:10:51,762 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): master:364650x0, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-15 21:10:51,771 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): master:36465-0x1016ad2d8bb0000 connected 2023-07-15 21:10:51,809 DEBUG [Listener at localhost/43845] zookeeper.ZKUtil(164): master:36465-0x1016ad2d8bb0000, quorum=127.0.0.1:50024, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-15 21:10:51,810 DEBUG [Listener at localhost/43845] zookeeper.ZKUtil(164): master:36465-0x1016ad2d8bb0000, quorum=127.0.0.1:50024, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-15 21:10:51,829 DEBUG [Listener at localhost/43845] zookeeper.ZKUtil(164): master:36465-0x1016ad2d8bb0000, quorum=127.0.0.1:50024, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-15 21:10:51,843 DEBUG [Listener at localhost/43845] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=36465 2023-07-15 21:10:51,845 DEBUG [Listener at localhost/43845] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=36465 2023-07-15 21:10:51,846 DEBUG [Listener at localhost/43845] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=36465 2023-07-15 21:10:51,851 DEBUG [Listener at localhost/43845] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=36465 2023-07-15 21:10:51,854 DEBUG [Listener at localhost/43845] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=36465 2023-07-15 21:10:51,862 INFO [Listener at localhost/43845] master.HMaster(444): hbase.rootdir=hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313, hbase.cluster.distributed=false 2023-07-15 21:10:51,933 INFO [Listener at localhost/43845] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-07-15 21:10:51,933 INFO [Listener at localhost/43845] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-15 21:10:51,933 INFO [Listener at localhost/43845] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-15 21:10:51,934 INFO [Listener at localhost/43845] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-15 21:10:51,934 INFO [Listener at localhost/43845] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-15 21:10:51,934 INFO [Listener at localhost/43845] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-15 21:10:51,939 INFO [Listener at localhost/43845] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-07-15 21:10:51,942 INFO [Listener at localhost/43845] ipc.NettyRpcServer(120): Bind to /172.31.14.131:37853 2023-07-15 21:10:51,945 INFO [Listener at localhost/43845] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-07-15 21:10:51,953 INFO [Listener at localhost/43845] mob.MobFileCache(124): MobFileCache disabled 2023-07-15 21:10:51,954 INFO [Listener at localhost/43845] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-15 21:10:51,956 INFO [Listener at localhost/43845] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-15 21:10:51,959 INFO [Listener at localhost/43845] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:37853 connecting to ZooKeeper ensemble=127.0.0.1:50024 2023-07-15 21:10:51,965 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): regionserver:378530x0, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-15 21:10:51,967 DEBUG [Listener at localhost/43845] zookeeper.ZKUtil(164): regionserver:378530x0, quorum=127.0.0.1:50024, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-15 21:10:51,970 DEBUG [Listener at localhost/43845] zookeeper.ZKUtil(164): regionserver:378530x0, quorum=127.0.0.1:50024, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-15 21:10:51,971 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:37853-0x1016ad2d8bb0001 connected 2023-07-15 21:10:51,972 DEBUG [Listener at localhost/43845] zookeeper.ZKUtil(164): regionserver:37853-0x1016ad2d8bb0001, quorum=127.0.0.1:50024, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-15 21:10:51,974 DEBUG [Listener at localhost/43845] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=37853 2023-07-15 21:10:51,978 DEBUG [Listener at localhost/43845] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=37853 2023-07-15 21:10:51,978 DEBUG [Listener at localhost/43845] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=37853 2023-07-15 21:10:51,980 DEBUG [Listener at localhost/43845] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=37853 2023-07-15 21:10:51,980 DEBUG [Listener at localhost/43845] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=37853 2023-07-15 21:10:51,999 INFO [Listener at localhost/43845] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-07-15 21:10:51,999 INFO [Listener at localhost/43845] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-15 21:10:51,999 INFO [Listener at localhost/43845] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-15 21:10:52,000 INFO [Listener at localhost/43845] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-15 21:10:52,000 INFO [Listener at localhost/43845] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-15 21:10:52,001 INFO [Listener at localhost/43845] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-15 21:10:52,001 INFO [Listener at localhost/43845] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-07-15 21:10:52,003 INFO [Listener at localhost/43845] ipc.NettyRpcServer(120): Bind to /172.31.14.131:39587 2023-07-15 21:10:52,003 INFO [Listener at localhost/43845] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-07-15 21:10:52,009 INFO [Listener at localhost/43845] mob.MobFileCache(124): MobFileCache disabled 2023-07-15 21:10:52,010 INFO [Listener at localhost/43845] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-15 21:10:52,013 INFO [Listener at localhost/43845] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-15 21:10:52,015 INFO [Listener at localhost/43845] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:39587 connecting to ZooKeeper ensemble=127.0.0.1:50024 2023-07-15 21:10:52,021 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): regionserver:395870x0, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-15 21:10:52,022 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:39587-0x1016ad2d8bb0002 connected 2023-07-15 21:10:52,022 DEBUG [Listener at localhost/43845] zookeeper.ZKUtil(164): regionserver:39587-0x1016ad2d8bb0002, quorum=127.0.0.1:50024, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-15 21:10:52,023 DEBUG [Listener at localhost/43845] zookeeper.ZKUtil(164): regionserver:39587-0x1016ad2d8bb0002, quorum=127.0.0.1:50024, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-15 21:10:52,024 DEBUG [Listener at localhost/43845] zookeeper.ZKUtil(164): regionserver:39587-0x1016ad2d8bb0002, quorum=127.0.0.1:50024, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-15 21:10:52,025 DEBUG [Listener at localhost/43845] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=39587 2023-07-15 21:10:52,025 DEBUG [Listener at localhost/43845] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=39587 2023-07-15 21:10:52,026 DEBUG [Listener at localhost/43845] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=39587 2023-07-15 21:10:52,030 DEBUG [Listener at localhost/43845] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=39587 2023-07-15 21:10:52,030 DEBUG [Listener at localhost/43845] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=39587 2023-07-15 21:10:52,043 INFO [Listener at localhost/43845] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-07-15 21:10:52,044 INFO [Listener at localhost/43845] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-15 21:10:52,044 INFO [Listener at localhost/43845] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-15 21:10:52,044 INFO [Listener at localhost/43845] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-15 21:10:52,044 INFO [Listener at localhost/43845] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-15 21:10:52,044 INFO [Listener at localhost/43845] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-15 21:10:52,045 INFO [Listener at localhost/43845] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-07-15 21:10:52,046 INFO [Listener at localhost/43845] ipc.NettyRpcServer(120): Bind to /172.31.14.131:39075 2023-07-15 21:10:52,047 INFO [Listener at localhost/43845] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-07-15 21:10:52,048 INFO [Listener at localhost/43845] mob.MobFileCache(124): MobFileCache disabled 2023-07-15 21:10:52,049 INFO [Listener at localhost/43845] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-15 21:10:52,050 INFO [Listener at localhost/43845] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-15 21:10:52,051 INFO [Listener at localhost/43845] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:39075 connecting to ZooKeeper ensemble=127.0.0.1:50024 2023-07-15 21:10:52,057 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): regionserver:390750x0, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-15 21:10:52,059 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:39075-0x1016ad2d8bb0003 connected 2023-07-15 21:10:52,061 DEBUG [Listener at localhost/43845] zookeeper.ZKUtil(164): regionserver:39075-0x1016ad2d8bb0003, quorum=127.0.0.1:50024, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-15 21:10:52,062 DEBUG [Listener at localhost/43845] zookeeper.ZKUtil(164): regionserver:39075-0x1016ad2d8bb0003, quorum=127.0.0.1:50024, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-15 21:10:52,063 DEBUG [Listener at localhost/43845] zookeeper.ZKUtil(164): regionserver:39075-0x1016ad2d8bb0003, quorum=127.0.0.1:50024, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-15 21:10:52,064 DEBUG [Listener at localhost/43845] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=39075 2023-07-15 21:10:52,065 DEBUG [Listener at localhost/43845] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=39075 2023-07-15 21:10:52,065 DEBUG [Listener at localhost/43845] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=39075 2023-07-15 21:10:52,065 DEBUG [Listener at localhost/43845] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=39075 2023-07-15 21:10:52,066 DEBUG [Listener at localhost/43845] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=39075 2023-07-15 21:10:52,071 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2168): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase4.apache.org,36465,1689455450507 2023-07-15 21:10:52,080 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): master:36465-0x1016ad2d8bb0000, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-07-15 21:10:52,082 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:36465-0x1016ad2d8bb0000, quorum=127.0.0.1:50024, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase4.apache.org,36465,1689455450507 2023-07-15 21:10:52,108 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): regionserver:37853-0x1016ad2d8bb0001, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-15 21:10:52,108 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): regionserver:39075-0x1016ad2d8bb0003, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-15 21:10:52,108 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): master:36465-0x1016ad2d8bb0000, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-15 21:10:52,110 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): master:36465-0x1016ad2d8bb0000, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-15 21:10:52,108 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): regionserver:39587-0x1016ad2d8bb0002, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-15 21:10:52,111 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:36465-0x1016ad2d8bb0000, quorum=127.0.0.1:50024, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-07-15 21:10:52,113 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:36465-0x1016ad2d8bb0000, quorum=127.0.0.1:50024, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-07-15 21:10:52,113 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(227): Deleting ZNode for /hbase/backup-masters/jenkins-hbase4.apache.org,36465,1689455450507 from backup master directory 2023-07-15 21:10:52,117 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): master:36465-0x1016ad2d8bb0000, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase4.apache.org,36465,1689455450507 2023-07-15 21:10:52,117 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): master:36465-0x1016ad2d8bb0000, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-07-15 21:10:52,118 WARN [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-15 21:10:52,118 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(237): Registered as active master=jenkins-hbase4.apache.org,36465,1689455450507 2023-07-15 21:10:52,122 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating data MemStoreChunkPool with chunk size 2 MB, max count 352, initial count 0 2023-07-15 21:10:52,124 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating index MemStoreChunkPool with chunk size 204.80 KB, max count 391, initial count 0 2023-07-15 21:10:52,249 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] util.FSUtils(620): Created cluster ID file at hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/hbase.id with ID: 14ad9563-6be8-40b5-a7ee-ca0759cda0ee 2023-07-15 21:10:52,298 INFO [master/jenkins-hbase4:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-15 21:10:52,322 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): master:36465-0x1016ad2d8bb0000, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-15 21:10:52,416 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x415ecc31 to 127.0.0.1:50024 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-15 21:10:52,473 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@8fdef96, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-15 21:10:52,506 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-15 21:10:52,509 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-07-15 21:10:52,533 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(264): ClientProtocol::create wrong number of arguments, should be hadoop 3.2 or below 2023-07-15 21:10:52,533 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(270): ClientProtocol::create wrong number of arguments, should be hadoop 2.x 2023-07-15 21:10:52,535 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(279): can not find SHOULD_REPLICATE flag, should be hadoop 2.x java.lang.IllegalArgumentException: No enum constant org.apache.hadoop.fs.CreateFlag.SHOULD_REPLICATE at java.lang.Enum.valueOf(Enum.java:238) at org.apache.hadoop.fs.CreateFlag.valueOf(CreateFlag.java:63) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.loadShouldReplicateFlag(FanOutOneBlockAsyncDFSOutputHelper.java:277) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.(FanOutOneBlockAsyncDFSOutputHelper.java:304) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:139) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-07-15 21:10:52,540 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(243): No decryptEncryptedDataEncryptionKey method in DFSClient, should be hadoop version with HDFS-12396 java.lang.NoSuchMethodException: org.apache.hadoop.hdfs.DFSClient.decryptEncryptedDataEncryptionKey(org.apache.hadoop.fs.FileEncryptionInfo) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelperWithoutHDFS12396(FanOutOneBlockAsyncDFSOutputSaslHelper.java:182) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelper(FanOutOneBlockAsyncDFSOutputSaslHelper.java:241) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.(FanOutOneBlockAsyncDFSOutputSaslHelper.java:252) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:140) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-07-15 21:10:52,542 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-15 21:10:52,590 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7693): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/MasterData/data/master/store-tmp 2023-07-15 21:10:52,665 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-15 21:10:52,665 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-07-15 21:10:52,665 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-15 21:10:52,665 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-15 21:10:52,665 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-07-15 21:10:52,665 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-15 21:10:52,665 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-15 21:10:52,666 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-15 21:10:52,679 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/MasterData/WALs/jenkins-hbase4.apache.org,36465,1689455450507 2023-07-15 21:10:52,710 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C36465%2C1689455450507, suffix=, logDir=hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/MasterData/WALs/jenkins-hbase4.apache.org,36465,1689455450507, archiveDir=hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/MasterData/oldWALs, maxLogs=10 2023-07-15 21:10:52,795 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46855,DS-cf2d8e8b-b29a-4800-acc6-92478c73ef7d,DISK] 2023-07-15 21:10:52,792 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:40117,DS-82af0571-8e40-4ba5-976e-f28b55eb8f8c,DISK] 2023-07-15 21:10:52,792 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:35451,DS-5cb6e29a-c48c-47ff-96ae-dc7e6eca3f9b,DISK] 2023-07-15 21:10:52,804 DEBUG [RS-EventLoopGroup-5-2] asyncfs.ProtobufDecoder(123): Hadoop 3.2 and below use unshaded protobuf. java.lang.ClassNotFoundException: org.apache.hadoop.thirdparty.protobuf.MessageLite at java.net.URLClassLoader.findClass(URLClassLoader.java:387) at java.lang.ClassLoader.loadClass(ClassLoader.java:418) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:352) at java.lang.ClassLoader.loadClass(ClassLoader.java:351) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.io.asyncfs.ProtobufDecoder.(ProtobufDecoder.java:118) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.processWriteBlockResponse(FanOutOneBlockAsyncDFSOutputHelper.java:340) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$100(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$4.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:424) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:557) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.addListener(DefaultPromise.java:185) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.initialize(FanOutOneBlockAsyncDFSOutputHelper.java:418) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$300(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:476) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:471) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setSuccess0(DefaultPromise.java:625) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.trySuccess(DefaultPromise.java:105) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPromise.trySuccess(DefaultChannelPromise.java:84) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:653) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:691) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-07-15 21:10:52,888 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/MasterData/WALs/jenkins-hbase4.apache.org,36465,1689455450507/jenkins-hbase4.apache.org%2C36465%2C1689455450507.1689455452726 2023-07-15 21:10:52,888 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:35451,DS-5cb6e29a-c48c-47ff-96ae-dc7e6eca3f9b,DISK], DatanodeInfoWithStorage[127.0.0.1:40117,DS-82af0571-8e40-4ba5-976e-f28b55eb8f8c,DISK], DatanodeInfoWithStorage[127.0.0.1:46855,DS-cf2d8e8b-b29a-4800-acc6-92478c73ef7d,DISK]] 2023-07-15 21:10:52,889 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7854): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-07-15 21:10:52,889 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-15 21:10:52,892 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7894): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-07-15 21:10:52,894 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7897): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-07-15 21:10:52,980 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-07-15 21:10:52,988 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-07-15 21:10:53,027 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-07-15 21:10:53,044 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-15 21:10:53,051 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-07-15 21:10:53,054 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-07-15 21:10:53,075 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1055): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-07-15 21:10:53,082 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-15 21:10:53,083 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1072): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68672113, jitterRate=0.023294225335121155}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-15 21:10:53,083 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(965): Region open journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-15 21:10:53,084 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-07-15 21:10:53,111 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-07-15 21:10:53,111 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-07-15 21:10:53,115 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-07-15 21:10:53,118 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 1 msec 2023-07-15 21:10:53,164 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 46 msec 2023-07-15 21:10:53,165 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(96): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-07-15 21:10:53,205 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-07-15 21:10:53,211 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-07-15 21:10:53,243 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-07-15 21:10:53,250 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-07-15 21:10:53,252 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:36465-0x1016ad2d8bb0000, quorum=127.0.0.1:50024, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-07-15 21:10:53,263 INFO [master/jenkins-hbase4:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-07-15 21:10:53,270 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:36465-0x1016ad2d8bb0000, quorum=127.0.0.1:50024, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-07-15 21:10:53,274 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): master:36465-0x1016ad2d8bb0000, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-15 21:10:53,277 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:36465-0x1016ad2d8bb0000, quorum=127.0.0.1:50024, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-07-15 21:10:53,278 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:36465-0x1016ad2d8bb0000, quorum=127.0.0.1:50024, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-07-15 21:10:53,300 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:36465-0x1016ad2d8bb0000, quorum=127.0.0.1:50024, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-07-15 21:10:53,308 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): master:36465-0x1016ad2d8bb0000, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-15 21:10:53,308 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): regionserver:39587-0x1016ad2d8bb0002, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-15 21:10:53,308 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): regionserver:37853-0x1016ad2d8bb0001, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-15 21:10:53,308 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): regionserver:39075-0x1016ad2d8bb0003, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-15 21:10:53,308 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): master:36465-0x1016ad2d8bb0000, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-15 21:10:53,313 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(744): Active/primary master=jenkins-hbase4.apache.org,36465,1689455450507, sessionid=0x1016ad2d8bb0000, setting cluster-up flag (Was=false) 2023-07-15 21:10:53,333 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): master:36465-0x1016ad2d8bb0000, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-15 21:10:53,343 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-07-15 21:10:53,347 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,36465,1689455450507 2023-07-15 21:10:53,354 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): master:36465-0x1016ad2d8bb0000, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-15 21:10:53,361 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-07-15 21:10:53,363 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,36465,1689455450507 2023-07-15 21:10:53,366 WARN [master/jenkins-hbase4:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/.hbase-snapshot/.tmp 2023-07-15 21:10:53,377 INFO [RS:1;jenkins-hbase4:39587] regionserver.HRegionServer(951): ClusterId : 14ad9563-6be8-40b5-a7ee-ca0759cda0ee 2023-07-15 21:10:53,379 INFO [RS:0;jenkins-hbase4:37853] regionserver.HRegionServer(951): ClusterId : 14ad9563-6be8-40b5-a7ee-ca0759cda0ee 2023-07-15 21:10:53,378 INFO [RS:2;jenkins-hbase4:39075] regionserver.HRegionServer(951): ClusterId : 14ad9563-6be8-40b5-a7ee-ca0759cda0ee 2023-07-15 21:10:53,392 DEBUG [RS:1;jenkins-hbase4:39587] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-07-15 21:10:53,392 DEBUG [RS:0;jenkins-hbase4:37853] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-07-15 21:10:53,392 DEBUG [RS:2;jenkins-hbase4:39075] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-07-15 21:10:53,400 DEBUG [RS:2;jenkins-hbase4:39075] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-07-15 21:10:53,400 DEBUG [RS:2;jenkins-hbase4:39075] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-07-15 21:10:53,401 DEBUG [RS:0;jenkins-hbase4:37853] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-07-15 21:10:53,401 DEBUG [RS:0;jenkins-hbase4:37853] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-07-15 21:10:53,404 DEBUG [RS:1;jenkins-hbase4:39587] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-07-15 21:10:53,405 DEBUG [RS:1;jenkins-hbase4:39587] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-07-15 21:10:53,406 DEBUG [RS:0;jenkins-hbase4:37853] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-07-15 21:10:53,406 DEBUG [RS:2;jenkins-hbase4:39075] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-07-15 21:10:53,408 DEBUG [RS:0;jenkins-hbase4:37853] zookeeper.ReadOnlyZKClient(139): Connect 0x51e12de0 to 127.0.0.1:50024 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-15 21:10:53,420 DEBUG [RS:2;jenkins-hbase4:39075] zookeeper.ReadOnlyZKClient(139): Connect 0x2ea9302f to 127.0.0.1:50024 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-15 21:10:53,423 DEBUG [RS:1;jenkins-hbase4:39587] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-07-15 21:10:53,434 DEBUG [RS:1;jenkins-hbase4:39587] zookeeper.ReadOnlyZKClient(139): Connect 0x3a45c34a to 127.0.0.1:50024 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-15 21:10:53,444 DEBUG [RS:0;jenkins-hbase4:37853] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@583a3bde, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-15 21:10:53,448 DEBUG [RS:0;jenkins-hbase4:37853] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@29287c66, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-07-15 21:10:53,451 DEBUG [RS:2;jenkins-hbase4:39075] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5538d7da, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-15 21:10:53,452 DEBUG [RS:2;jenkins-hbase4:39075] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@566d6b48, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-07-15 21:10:53,468 DEBUG [RS:1;jenkins-hbase4:39587] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1f26341c, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-15 21:10:53,468 DEBUG [RS:1;jenkins-hbase4:39587] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@124ff9cf, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-07-15 21:10:53,482 DEBUG [RS:0;jenkins-hbase4:37853] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase4:37853 2023-07-15 21:10:53,482 DEBUG [RS:1;jenkins-hbase4:39587] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase4:39587 2023-07-15 21:10:53,494 INFO [RS:1;jenkins-hbase4:39587] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-07-15 21:10:53,494 INFO [RS:1;jenkins-hbase4:39587] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-07-15 21:10:53,504 INFO [RS:0;jenkins-hbase4:37853] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-07-15 21:10:53,511 INFO [RS:0;jenkins-hbase4:37853] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-07-15 21:10:53,515 DEBUG [RS:2;jenkins-hbase4:39075] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:2;jenkins-hbase4:39075 2023-07-15 21:10:53,515 INFO [RS:2;jenkins-hbase4:39075] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-07-15 21:10:53,515 INFO [RS:2;jenkins-hbase4:39075] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-07-15 21:10:53,540 DEBUG [RS:2;jenkins-hbase4:39075] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-07-15 21:10:53,540 DEBUG [RS:1;jenkins-hbase4:39587] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-07-15 21:10:53,542 INFO [RS:2;jenkins-hbase4:39075] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-15 21:10:53,542 DEBUG [RS:2;jenkins-hbase4:39075] regionserver.HRegionServer(1022): About to register with Master. 2023-07-15 21:10:53,541 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2930): Registered master coprocessor service: service=AccessControlService 2023-07-15 21:10:53,541 DEBUG [RS:0;jenkins-hbase4:37853] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-07-15 21:10:53,543 INFO [RS:1;jenkins-hbase4:39587] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-15 21:10:53,544 DEBUG [RS:1;jenkins-hbase4:39587] regionserver.HRegionServer(1022): About to register with Master. 2023-07-15 21:10:53,544 INFO [RS:0;jenkins-hbase4:37853] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-15 21:10:53,544 INFO [master/jenkins-hbase4:0:becomeActiveMaster] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-15 21:10:53,544 DEBUG [RS:0;jenkins-hbase4:37853] regionserver.HRegionServer(1022): About to register with Master. 2023-07-15 21:10:53,544 INFO [master/jenkins-hbase4:0:becomeActiveMaster] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver loaded, priority=536870912. 2023-07-15 21:10:53,548 INFO [RS:1;jenkins-hbase4:39587] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,36465,1689455450507 with isa=jenkins-hbase4.apache.org/172.31.14.131:39587, startcode=1689455451998 2023-07-15 21:10:53,548 INFO [RS:0;jenkins-hbase4:37853] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,36465,1689455450507 with isa=jenkins-hbase4.apache.org/172.31.14.131:37853, startcode=1689455451932 2023-07-15 21:10:53,548 INFO [RS:2;jenkins-hbase4:39075] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,36465,1689455450507 with isa=jenkins-hbase4.apache.org/172.31.14.131:39075, startcode=1689455452043 2023-07-15 21:10:53,569 DEBUG [RS:1;jenkins-hbase4:39587] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-07-15 21:10:53,570 DEBUG [RS:2;jenkins-hbase4:39075] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-07-15 21:10:53,569 DEBUG [RS:0;jenkins-hbase4:37853] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-07-15 21:10:53,637 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:41143, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.2 (auth:SIMPLE), service=RegionServerStatusService 2023-07-15 21:10:53,637 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:59341, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.1 (auth:SIMPLE), service=RegionServerStatusService 2023-07-15 21:10:53,637 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:36389, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.0 (auth:SIMPLE), service=RegionServerStatusService 2023-07-15 21:10:53,655 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=36465] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-07-15 21:10:53,656 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-07-15 21:10:53,667 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=36465] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-07-15 21:10:53,669 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=36465] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-07-15 21:10:53,669 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-07-15 21:10:53,669 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-07-15 21:10:53,670 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-07-15 21:10:53,671 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-07-15 21:10:53,671 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase4:0, corePoolSize=10, maxPoolSize=10 2023-07-15 21:10:53,671 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-15 21:10:53,671 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-07-15 21:10:53,671 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-15 21:10:53,680 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1689455483679 2023-07-15 21:10:53,686 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-07-15 21:10:53,689 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-07-15 21:10:53,690 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-07-15 21:10:53,695 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-07-15 21:10:53,700 DEBUG [RS:1;jenkins-hbase4:39587] regionserver.HRegionServer(2830): Master is not running yet 2023-07-15 21:10:53,700 WARN [RS:1;jenkins-hbase4:39587] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 100 ms and then retrying. 2023-07-15 21:10:53,703 DEBUG [RS:2;jenkins-hbase4:39075] regionserver.HRegionServer(2830): Master is not running yet 2023-07-15 21:10:53,703 DEBUG [RS:0;jenkins-hbase4:37853] regionserver.HRegionServer(2830): Master is not running yet 2023-07-15 21:10:53,703 WARN [RS:2;jenkins-hbase4:39075] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 100 ms and then retrying. 2023-07-15 21:10:53,704 WARN [RS:0;jenkins-hbase4:37853] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 100 ms and then retrying. 2023-07-15 21:10:53,710 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-07-15 21:10:53,717 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-07-15 21:10:53,719 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-07-15 21:10:53,720 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-07-15 21:10:53,720 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-07-15 21:10:53,721 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-07-15 21:10:53,726 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-07-15 21:10:53,729 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-07-15 21:10:53,729 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-07-15 21:10:53,733 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-07-15 21:10:53,733 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-07-15 21:10:53,744 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1689455453744,5,FailOnTimeoutGroup] 2023-07-15 21:10:53,746 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1689455453745,5,FailOnTimeoutGroup] 2023-07-15 21:10:53,747 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-07-15 21:10:53,747 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1461): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-07-15 21:10:53,749 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-07-15 21:10:53,750 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-07-15 21:10:53,798 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-07-15 21:10:53,799 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-07-15 21:10:53,800 INFO [PEWorker-1] regionserver.HRegion(7675): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313 2023-07-15 21:10:53,801 INFO [RS:1;jenkins-hbase4:39587] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,36465,1689455450507 with isa=jenkins-hbase4.apache.org/172.31.14.131:39587, startcode=1689455451998 2023-07-15 21:10:53,806 INFO [RS:0;jenkins-hbase4:37853] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,36465,1689455450507 with isa=jenkins-hbase4.apache.org/172.31.14.131:37853, startcode=1689455451932 2023-07-15 21:10:53,811 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=36465] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,39587,1689455451998 2023-07-15 21:10:53,807 INFO [RS:2;jenkins-hbase4:39075] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,36465,1689455450507 with isa=jenkins-hbase4.apache.org/172.31.14.131:39075, startcode=1689455452043 2023-07-15 21:10:53,817 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=36465] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,37853,1689455451932 2023-07-15 21:10:53,818 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=36465] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,39075,1689455452043 2023-07-15 21:10:53,820 DEBUG [RS:1;jenkins-hbase4:39587] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313 2023-07-15 21:10:53,820 DEBUG [RS:1;jenkins-hbase4:39587] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:46859 2023-07-15 21:10:53,820 DEBUG [RS:1;jenkins-hbase4:39587] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-07-15 21:10:53,823 DEBUG [RS:0;jenkins-hbase4:37853] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313 2023-07-15 21:10:53,823 DEBUG [RS:0;jenkins-hbase4:37853] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:46859 2023-07-15 21:10:53,823 DEBUG [RS:0;jenkins-hbase4:37853] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-07-15 21:10:53,828 DEBUG [RS:2;jenkins-hbase4:39075] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313 2023-07-15 21:10:53,828 DEBUG [RS:2;jenkins-hbase4:39075] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:46859 2023-07-15 21:10:53,828 DEBUG [RS:2;jenkins-hbase4:39075] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-07-15 21:10:53,833 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): master:36465-0x1016ad2d8bb0000, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-15 21:10:53,837 DEBUG [RS:0;jenkins-hbase4:37853] zookeeper.ZKUtil(162): regionserver:37853-0x1016ad2d8bb0001, quorum=127.0.0.1:50024, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,37853,1689455451932 2023-07-15 21:10:53,837 DEBUG [RS:2;jenkins-hbase4:39075] zookeeper.ZKUtil(162): regionserver:39075-0x1016ad2d8bb0003, quorum=127.0.0.1:50024, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,39075,1689455452043 2023-07-15 21:10:53,837 DEBUG [RS:1;jenkins-hbase4:39587] zookeeper.ZKUtil(162): regionserver:39587-0x1016ad2d8bb0002, quorum=127.0.0.1:50024, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,39587,1689455451998 2023-07-15 21:10:53,837 WARN [RS:0;jenkins-hbase4:37853] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-15 21:10:53,837 WARN [RS:2;jenkins-hbase4:39075] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-15 21:10:53,837 WARN [RS:1;jenkins-hbase4:39587] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-15 21:10:53,840 INFO [RS:0;jenkins-hbase4:37853] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-15 21:10:53,840 INFO [RS:1;jenkins-hbase4:39587] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-15 21:10:53,842 DEBUG [RS:0;jenkins-hbase4:37853] regionserver.HRegionServer(1948): logDir=hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/WALs/jenkins-hbase4.apache.org,37853,1689455451932 2023-07-15 21:10:53,842 DEBUG [RS:1;jenkins-hbase4:39587] regionserver.HRegionServer(1948): logDir=hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/WALs/jenkins-hbase4.apache.org,39587,1689455451998 2023-07-15 21:10:53,840 INFO [RS:2;jenkins-hbase4:39075] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-15 21:10:53,843 DEBUG [RS:2;jenkins-hbase4:39075] regionserver.HRegionServer(1948): logDir=hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/WALs/jenkins-hbase4.apache.org,39075,1689455452043 2023-07-15 21:10:53,848 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,37853,1689455451932] 2023-07-15 21:10:53,848 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,39075,1689455452043] 2023-07-15 21:10:53,848 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,39587,1689455451998] 2023-07-15 21:10:53,895 DEBUG [RS:1;jenkins-hbase4:39587] zookeeper.ZKUtil(162): regionserver:39587-0x1016ad2d8bb0002, quorum=127.0.0.1:50024, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,39075,1689455452043 2023-07-15 21:10:53,895 DEBUG [RS:2;jenkins-hbase4:39075] zookeeper.ZKUtil(162): regionserver:39075-0x1016ad2d8bb0003, quorum=127.0.0.1:50024, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,39075,1689455452043 2023-07-15 21:10:53,896 DEBUG [RS:0;jenkins-hbase4:37853] zookeeper.ZKUtil(162): regionserver:37853-0x1016ad2d8bb0001, quorum=127.0.0.1:50024, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,39075,1689455452043 2023-07-15 21:10:53,897 DEBUG [RS:1;jenkins-hbase4:39587] zookeeper.ZKUtil(162): regionserver:39587-0x1016ad2d8bb0002, quorum=127.0.0.1:50024, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,39587,1689455451998 2023-07-15 21:10:53,896 DEBUG [RS:2;jenkins-hbase4:39075] zookeeper.ZKUtil(162): regionserver:39075-0x1016ad2d8bb0003, quorum=127.0.0.1:50024, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,39587,1689455451998 2023-07-15 21:10:53,897 DEBUG [RS:1;jenkins-hbase4:39587] zookeeper.ZKUtil(162): regionserver:39587-0x1016ad2d8bb0002, quorum=127.0.0.1:50024, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,37853,1689455451932 2023-07-15 21:10:53,898 DEBUG [RS:0;jenkins-hbase4:37853] zookeeper.ZKUtil(162): regionserver:37853-0x1016ad2d8bb0001, quorum=127.0.0.1:50024, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,39587,1689455451998 2023-07-15 21:10:53,898 DEBUG [RS:2;jenkins-hbase4:39075] zookeeper.ZKUtil(162): regionserver:39075-0x1016ad2d8bb0003, quorum=127.0.0.1:50024, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,37853,1689455451932 2023-07-15 21:10:53,898 DEBUG [RS:0;jenkins-hbase4:37853] zookeeper.ZKUtil(162): regionserver:37853-0x1016ad2d8bb0001, quorum=127.0.0.1:50024, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,37853,1689455451932 2023-07-15 21:10:53,899 DEBUG [PEWorker-1] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-15 21:10:53,903 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-07-15 21:10:53,908 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/data/hbase/meta/1588230740/info 2023-07-15 21:10:53,909 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-07-15 21:10:53,911 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-15 21:10:53,911 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-07-15 21:10:53,915 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/data/hbase/meta/1588230740/rep_barrier 2023-07-15 21:10:53,915 DEBUG [RS:0;jenkins-hbase4:37853] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-07-15 21:10:53,915 DEBUG [RS:1;jenkins-hbase4:39587] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-07-15 21:10:53,919 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-07-15 21:10:53,915 DEBUG [RS:2;jenkins-hbase4:39075] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-07-15 21:10:53,920 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-15 21:10:53,921 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-07-15 21:10:53,924 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/data/hbase/meta/1588230740/table 2023-07-15 21:10:53,925 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-07-15 21:10:53,926 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-15 21:10:53,928 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/data/hbase/meta/1588230740 2023-07-15 21:10:53,930 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/data/hbase/meta/1588230740 2023-07-15 21:10:53,933 INFO [RS:2;jenkins-hbase4:39075] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-07-15 21:10:53,934 INFO [RS:0;jenkins-hbase4:37853] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-07-15 21:10:53,933 INFO [RS:1;jenkins-hbase4:39587] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-07-15 21:10:53,935 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-15 21:10:53,938 DEBUG [PEWorker-1] regionserver.HRegion(1055): writing seq id for 1588230740 2023-07-15 21:10:53,941 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-15 21:10:53,942 INFO [PEWorker-1] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=75442869, jitterRate=0.12418635189533234}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-15 21:10:53,942 DEBUG [PEWorker-1] regionserver.HRegion(965): Region open journal for 1588230740: 2023-07-15 21:10:53,942 DEBUG [PEWorker-1] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-07-15 21:10:53,942 INFO [PEWorker-1] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-07-15 21:10:53,943 DEBUG [PEWorker-1] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-07-15 21:10:53,943 DEBUG [PEWorker-1] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-07-15 21:10:53,943 DEBUG [PEWorker-1] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-07-15 21:10:53,950 INFO [PEWorker-1] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-07-15 21:10:53,950 DEBUG [PEWorker-1] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-07-15 21:10:53,957 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-07-15 21:10:53,957 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-07-15 21:10:53,963 INFO [RS:0;jenkins-hbase4:37853] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-07-15 21:10:53,963 INFO [RS:2;jenkins-hbase4:39075] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-07-15 21:10:53,963 INFO [RS:1;jenkins-hbase4:39587] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-07-15 21:10:53,969 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-07-15 21:10:53,969 INFO [RS:0;jenkins-hbase4:37853] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-15 21:10:53,969 INFO [RS:0;jenkins-hbase4:37853] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-15 21:10:53,969 INFO [RS:2;jenkins-hbase4:39075] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-15 21:10:53,970 INFO [RS:1;jenkins-hbase4:39587] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-15 21:10:53,970 INFO [RS:2;jenkins-hbase4:39075] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-15 21:10:53,970 INFO [RS:1;jenkins-hbase4:39587] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-15 21:10:53,971 INFO [RS:0;jenkins-hbase4:37853] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-07-15 21:10:53,973 INFO [RS:2;jenkins-hbase4:39075] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-07-15 21:10:53,976 INFO [RS:1;jenkins-hbase4:39587] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-07-15 21:10:53,983 INFO [RS:2;jenkins-hbase4:39075] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-07-15 21:10:53,983 INFO [RS:1;jenkins-hbase4:39587] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-07-15 21:10:53,983 INFO [RS:0;jenkins-hbase4:37853] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-07-15 21:10:53,984 DEBUG [RS:2;jenkins-hbase4:39075] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-15 21:10:53,984 DEBUG [RS:1;jenkins-hbase4:39587] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-15 21:10:53,984 DEBUG [RS:2;jenkins-hbase4:39075] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-15 21:10:53,984 DEBUG [RS:1;jenkins-hbase4:39587] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-15 21:10:53,984 DEBUG [RS:2;jenkins-hbase4:39075] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-15 21:10:53,984 DEBUG [RS:0;jenkins-hbase4:37853] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-15 21:10:53,985 DEBUG [RS:2;jenkins-hbase4:39075] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-15 21:10:53,985 DEBUG [RS:0;jenkins-hbase4:37853] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-15 21:10:53,985 DEBUG [RS:2;jenkins-hbase4:39075] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-15 21:10:53,985 DEBUG [RS:0;jenkins-hbase4:37853] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-15 21:10:53,985 DEBUG [RS:2;jenkins-hbase4:39075] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-07-15 21:10:53,985 DEBUG [RS:0;jenkins-hbase4:37853] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-15 21:10:53,985 DEBUG [RS:2;jenkins-hbase4:39075] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-15 21:10:53,985 DEBUG [RS:0;jenkins-hbase4:37853] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-15 21:10:53,985 DEBUG [RS:2;jenkins-hbase4:39075] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-15 21:10:53,985 DEBUG [RS:0;jenkins-hbase4:37853] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-07-15 21:10:53,985 DEBUG [RS:2;jenkins-hbase4:39075] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-15 21:10:53,985 DEBUG [RS:0;jenkins-hbase4:37853] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-15 21:10:53,985 DEBUG [RS:2;jenkins-hbase4:39075] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-15 21:10:53,986 DEBUG [RS:0;jenkins-hbase4:37853] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-15 21:10:53,985 DEBUG [RS:1;jenkins-hbase4:39587] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-15 21:10:53,986 DEBUG [RS:0;jenkins-hbase4:37853] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-15 21:10:53,986 DEBUG [RS:0;jenkins-hbase4:37853] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-15 21:10:53,986 DEBUG [RS:1;jenkins-hbase4:39587] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-15 21:10:53,986 DEBUG [RS:1;jenkins-hbase4:39587] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-15 21:10:53,986 DEBUG [RS:1;jenkins-hbase4:39587] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-07-15 21:10:53,986 DEBUG [RS:1;jenkins-hbase4:39587] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-15 21:10:53,986 DEBUG [RS:1;jenkins-hbase4:39587] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-15 21:10:53,987 DEBUG [RS:1;jenkins-hbase4:39587] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-15 21:10:53,987 DEBUG [RS:1;jenkins-hbase4:39587] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-15 21:10:53,993 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-07-15 21:10:53,998 INFO [RS:1;jenkins-hbase4:39587] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-07-15 21:10:53,999 INFO [RS:1;jenkins-hbase4:39587] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-07-15 21:10:53,999 INFO [RS:1;jenkins-hbase4:39587] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-07-15 21:10:54,006 INFO [RS:0;jenkins-hbase4:37853] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-07-15 21:10:54,006 INFO [RS:0;jenkins-hbase4:37853] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-07-15 21:10:54,007 INFO [RS:0;jenkins-hbase4:37853] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-07-15 21:10:54,007 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-07-15 21:10:54,010 INFO [RS:2;jenkins-hbase4:39075] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-07-15 21:10:54,011 INFO [RS:2;jenkins-hbase4:39075] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-07-15 21:10:54,011 INFO [RS:2;jenkins-hbase4:39075] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-07-15 21:10:54,036 INFO [RS:1;jenkins-hbase4:39587] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-07-15 21:10:54,040 INFO [RS:1;jenkins-hbase4:39587] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,39587,1689455451998-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-15 21:10:54,067 INFO [RS:2;jenkins-hbase4:39075] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-07-15 21:10:54,068 INFO [RS:2;jenkins-hbase4:39075] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,39075,1689455452043-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-15 21:10:54,086 INFO [RS:0;jenkins-hbase4:37853] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-07-15 21:10:54,092 INFO [RS:0;jenkins-hbase4:37853] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,37853,1689455451932-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-15 21:10:54,109 INFO [RS:1;jenkins-hbase4:39587] regionserver.Replication(203): jenkins-hbase4.apache.org,39587,1689455451998 started 2023-07-15 21:10:54,110 INFO [RS:1;jenkins-hbase4:39587] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,39587,1689455451998, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:39587, sessionid=0x1016ad2d8bb0002 2023-07-15 21:10:54,110 DEBUG [RS:1;jenkins-hbase4:39587] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-07-15 21:10:54,110 DEBUG [RS:1;jenkins-hbase4:39587] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,39587,1689455451998 2023-07-15 21:10:54,110 DEBUG [RS:1;jenkins-hbase4:39587] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,39587,1689455451998' 2023-07-15 21:10:54,110 DEBUG [RS:1;jenkins-hbase4:39587] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-15 21:10:54,120 DEBUG [RS:1;jenkins-hbase4:39587] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-15 21:10:54,121 DEBUG [RS:1;jenkins-hbase4:39587] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-07-15 21:10:54,121 DEBUG [RS:1;jenkins-hbase4:39587] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-07-15 21:10:54,121 DEBUG [RS:1;jenkins-hbase4:39587] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,39587,1689455451998 2023-07-15 21:10:54,121 DEBUG [RS:1;jenkins-hbase4:39587] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,39587,1689455451998' 2023-07-15 21:10:54,121 DEBUG [RS:1;jenkins-hbase4:39587] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 21:10:54,122 DEBUG [RS:1;jenkins-hbase4:39587] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 21:10:54,122 DEBUG [RS:1;jenkins-hbase4:39587] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-07-15 21:10:54,123 INFO [RS:1;jenkins-hbase4:39587] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-07-15 21:10:54,123 INFO [RS:1;jenkins-hbase4:39587] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-07-15 21:10:54,124 INFO [RS:2;jenkins-hbase4:39075] regionserver.Replication(203): jenkins-hbase4.apache.org,39075,1689455452043 started 2023-07-15 21:10:54,124 INFO [RS:2;jenkins-hbase4:39075] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,39075,1689455452043, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:39075, sessionid=0x1016ad2d8bb0003 2023-07-15 21:10:54,125 INFO [RS:0;jenkins-hbase4:37853] regionserver.Replication(203): jenkins-hbase4.apache.org,37853,1689455451932 started 2023-07-15 21:10:54,126 INFO [RS:0;jenkins-hbase4:37853] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,37853,1689455451932, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:37853, sessionid=0x1016ad2d8bb0001 2023-07-15 21:10:54,126 DEBUG [RS:2;jenkins-hbase4:39075] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-07-15 21:10:54,126 DEBUG [RS:0;jenkins-hbase4:37853] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-07-15 21:10:54,126 DEBUG [RS:2;jenkins-hbase4:39075] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,39075,1689455452043 2023-07-15 21:10:54,127 DEBUG [RS:0;jenkins-hbase4:37853] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,37853,1689455451932 2023-07-15 21:10:54,127 DEBUG [RS:2;jenkins-hbase4:39075] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,39075,1689455452043' 2023-07-15 21:10:54,128 DEBUG [RS:2;jenkins-hbase4:39075] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-15 21:10:54,128 DEBUG [RS:0;jenkins-hbase4:37853] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,37853,1689455451932' 2023-07-15 21:10:54,128 DEBUG [RS:0;jenkins-hbase4:37853] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-15 21:10:54,128 DEBUG [RS:2;jenkins-hbase4:39075] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-15 21:10:54,128 DEBUG [RS:0;jenkins-hbase4:37853] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-15 21:10:54,129 DEBUG [RS:2;jenkins-hbase4:39075] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-07-15 21:10:54,129 DEBUG [RS:0;jenkins-hbase4:37853] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-07-15 21:10:54,129 DEBUG [RS:0;jenkins-hbase4:37853] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-07-15 21:10:54,129 DEBUG [RS:2;jenkins-hbase4:39075] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-07-15 21:10:54,129 DEBUG [RS:0;jenkins-hbase4:37853] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,37853,1689455451932 2023-07-15 21:10:54,130 DEBUG [RS:2;jenkins-hbase4:39075] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,39075,1689455452043 2023-07-15 21:10:54,130 DEBUG [RS:2;jenkins-hbase4:39075] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,39075,1689455452043' 2023-07-15 21:10:54,130 DEBUG [RS:2;jenkins-hbase4:39075] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 21:10:54,130 DEBUG [RS:0;jenkins-hbase4:37853] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,37853,1689455451932' 2023-07-15 21:10:54,130 DEBUG [RS:0;jenkins-hbase4:37853] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 21:10:54,130 DEBUG [RS:2;jenkins-hbase4:39075] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 21:10:54,130 DEBUG [RS:0;jenkins-hbase4:37853] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 21:10:54,131 DEBUG [RS:2;jenkins-hbase4:39075] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-07-15 21:10:54,131 DEBUG [RS:0;jenkins-hbase4:37853] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-07-15 21:10:54,131 INFO [RS:2;jenkins-hbase4:39075] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-07-15 21:10:54,131 INFO [RS:0;jenkins-hbase4:37853] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-07-15 21:10:54,132 INFO [RS:0;jenkins-hbase4:37853] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-07-15 21:10:54,132 INFO [RS:2;jenkins-hbase4:39075] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-07-15 21:10:54,165 DEBUG [jenkins-hbase4:36465] assignment.AssignmentManager(2176): Processing assignQueue; systemServersCount=3, allServersCount=3 2023-07-15 21:10:54,170 DEBUG [jenkins-hbase4:36465] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-15 21:10:54,180 DEBUG [jenkins-hbase4:36465] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-15 21:10:54,181 DEBUG [jenkins-hbase4:36465] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-15 21:10:54,181 DEBUG [jenkins-hbase4:36465] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-15 21:10:54,181 DEBUG [jenkins-hbase4:36465] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-15 21:10:54,184 INFO [PEWorker-4] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,39075,1689455452043, state=OPENING 2023-07-15 21:10:54,193 DEBUG [PEWorker-4] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-07-15 21:10:54,195 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): master:36465-0x1016ad2d8bb0000, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-15 21:10:54,196 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-07-15 21:10:54,199 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,39075,1689455452043}] 2023-07-15 21:10:54,234 INFO [RS:1;jenkins-hbase4:39587] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C39587%2C1689455451998, suffix=, logDir=hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/WALs/jenkins-hbase4.apache.org,39587,1689455451998, archiveDir=hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/oldWALs, maxLogs=32 2023-07-15 21:10:54,235 INFO [RS:0;jenkins-hbase4:37853] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C37853%2C1689455451932, suffix=, logDir=hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/WALs/jenkins-hbase4.apache.org,37853,1689455451932, archiveDir=hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/oldWALs, maxLogs=32 2023-07-15 21:10:54,236 INFO [RS:2;jenkins-hbase4:39075] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C39075%2C1689455452043, suffix=, logDir=hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/WALs/jenkins-hbase4.apache.org,39075,1689455452043, archiveDir=hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/oldWALs, maxLogs=32 2023-07-15 21:10:54,277 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46855,DS-cf2d8e8b-b29a-4800-acc6-92478c73ef7d,DISK] 2023-07-15 21:10:54,277 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:35451,DS-5cb6e29a-c48c-47ff-96ae-dc7e6eca3f9b,DISK] 2023-07-15 21:10:54,277 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:40117,DS-82af0571-8e40-4ba5-976e-f28b55eb8f8c,DISK] 2023-07-15 21:10:54,283 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:40117,DS-82af0571-8e40-4ba5-976e-f28b55eb8f8c,DISK] 2023-07-15 21:10:54,287 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46855,DS-cf2d8e8b-b29a-4800-acc6-92478c73ef7d,DISK] 2023-07-15 21:10:54,287 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:35451,DS-5cb6e29a-c48c-47ff-96ae-dc7e6eca3f9b,DISK] 2023-07-15 21:10:54,292 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:40117,DS-82af0571-8e40-4ba5-976e-f28b55eb8f8c,DISK] 2023-07-15 21:10:54,292 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:35451,DS-5cb6e29a-c48c-47ff-96ae-dc7e6eca3f9b,DISK] 2023-07-15 21:10:54,292 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46855,DS-cf2d8e8b-b29a-4800-acc6-92478c73ef7d,DISK] 2023-07-15 21:10:54,305 INFO [RS:2;jenkins-hbase4:39075] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/WALs/jenkins-hbase4.apache.org,39075,1689455452043/jenkins-hbase4.apache.org%2C39075%2C1689455452043.1689455454238 2023-07-15 21:10:54,306 INFO [RS:1;jenkins-hbase4:39587] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/WALs/jenkins-hbase4.apache.org,39587,1689455451998/jenkins-hbase4.apache.org%2C39587%2C1689455451998.1689455454237 2023-07-15 21:10:54,316 DEBUG [RS:2;jenkins-hbase4:39075] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:46855,DS-cf2d8e8b-b29a-4800-acc6-92478c73ef7d,DISK], DatanodeInfoWithStorage[127.0.0.1:35451,DS-5cb6e29a-c48c-47ff-96ae-dc7e6eca3f9b,DISK], DatanodeInfoWithStorage[127.0.0.1:40117,DS-82af0571-8e40-4ba5-976e-f28b55eb8f8c,DISK]] 2023-07-15 21:10:54,316 INFO [RS:0;jenkins-hbase4:37853] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/WALs/jenkins-hbase4.apache.org,37853,1689455451932/jenkins-hbase4.apache.org%2C37853%2C1689455451932.1689455454238 2023-07-15 21:10:54,317 DEBUG [RS:0;jenkins-hbase4:37853] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:46855,DS-cf2d8e8b-b29a-4800-acc6-92478c73ef7d,DISK], DatanodeInfoWithStorage[127.0.0.1:35451,DS-5cb6e29a-c48c-47ff-96ae-dc7e6eca3f9b,DISK], DatanodeInfoWithStorage[127.0.0.1:40117,DS-82af0571-8e40-4ba5-976e-f28b55eb8f8c,DISK]] 2023-07-15 21:10:54,322 DEBUG [RS:1;jenkins-hbase4:39587] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:35451,DS-5cb6e29a-c48c-47ff-96ae-dc7e6eca3f9b,DISK], DatanodeInfoWithStorage[127.0.0.1:46855,DS-cf2d8e8b-b29a-4800-acc6-92478c73ef7d,DISK], DatanodeInfoWithStorage[127.0.0.1:40117,DS-82af0571-8e40-4ba5-976e-f28b55eb8f8c,DISK]] 2023-07-15 21:10:54,412 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,39075,1689455452043 2023-07-15 21:10:54,416 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-15 21:10:54,419 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:43998, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-15 21:10:54,441 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:meta,,1.1588230740 2023-07-15 21:10:54,442 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-15 21:10:54,446 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C39075%2C1689455452043.meta, suffix=.meta, logDir=hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/WALs/jenkins-hbase4.apache.org,39075,1689455452043, archiveDir=hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/oldWALs, maxLogs=32 2023-07-15 21:10:54,475 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:40117,DS-82af0571-8e40-4ba5-976e-f28b55eb8f8c,DISK] 2023-07-15 21:10:54,476 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46855,DS-cf2d8e8b-b29a-4800-acc6-92478c73ef7d,DISK] 2023-07-15 21:10:54,477 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:35451,DS-5cb6e29a-c48c-47ff-96ae-dc7e6eca3f9b,DISK] 2023-07-15 21:10:54,488 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/WALs/jenkins-hbase4.apache.org,39075,1689455452043/jenkins-hbase4.apache.org%2C39075%2C1689455452043.meta.1689455454448.meta 2023-07-15 21:10:54,489 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:40117,DS-82af0571-8e40-4ba5-976e-f28b55eb8f8c,DISK], DatanodeInfoWithStorage[127.0.0.1:46855,DS-cf2d8e8b-b29a-4800-acc6-92478c73ef7d,DISK], DatanodeInfoWithStorage[127.0.0.1:35451,DS-5cb6e29a-c48c-47ff-96ae-dc7e6eca3f9b,DISK]] 2023-07-15 21:10:54,490 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-07-15 21:10:54,491 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=AccessControlService 2023-07-15 21:10:54,493 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-15 21:10:54,494 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-07-15 21:10:54,497 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-07-15 21:10:54,499 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-07-15 21:10:54,518 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-07-15 21:10:54,518 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-15 21:10:54,518 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 1588230740 2023-07-15 21:10:54,518 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 1588230740 2023-07-15 21:10:54,522 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-07-15 21:10:54,526 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/data/hbase/meta/1588230740/info 2023-07-15 21:10:54,526 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/data/hbase/meta/1588230740/info 2023-07-15 21:10:54,527 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-07-15 21:10:54,528 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-15 21:10:54,528 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-07-15 21:10:54,530 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/data/hbase/meta/1588230740/rep_barrier 2023-07-15 21:10:54,530 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/data/hbase/meta/1588230740/rep_barrier 2023-07-15 21:10:54,531 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-07-15 21:10:54,532 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-15 21:10:54,532 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-07-15 21:10:54,534 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/data/hbase/meta/1588230740/table 2023-07-15 21:10:54,534 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/data/hbase/meta/1588230740/table 2023-07-15 21:10:54,535 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-07-15 21:10:54,535 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-15 21:10:54,541 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/data/hbase/meta/1588230740 2023-07-15 21:10:54,544 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/data/hbase/meta/1588230740 2023-07-15 21:10:54,548 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-15 21:10:54,551 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 1588230740 2023-07-15 21:10:54,553 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59561115, jitterRate=-0.11247022449970245}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-15 21:10:54,557 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 1588230740: 2023-07-15 21:10:54,576 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1689455454401 2023-07-15 21:10:54,598 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:meta,,1.1588230740 2023-07-15 21:10:54,599 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:meta,,1.1588230740 2023-07-15 21:10:54,604 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,39075,1689455452043, state=OPEN 2023-07-15 21:10:54,609 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): master:36465-0x1016ad2d8bb0000, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-07-15 21:10:54,609 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-07-15 21:10:54,615 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-07-15 21:10:54,615 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,39075,1689455452043 in 410 msec 2023-07-15 21:10:54,621 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-07-15 21:10:54,621 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 647 msec 2023-07-15 21:10:54,627 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 1.0730 sec 2023-07-15 21:10:54,628 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(953): Wait for region servers to report in: status=null, state=RUNNING, startTime=1689455454627, completionTime=-1 2023-07-15 21:10:54,628 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=3; waited=0ms, expected min=3 server(s), max=3 server(s), master is running 2023-07-15 21:10:54,628 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1517): Joining cluster... 2023-07-15 21:10:54,721 DEBUG [hconnection-0x401a2f8d-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-15 21:10:54,725 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:44006, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-15 21:10:54,758 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1529): Number of RegionServers=3 2023-07-15 21:10:54,758 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1689455514758 2023-07-15 21:10:54,759 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1689455574759 2023-07-15 21:10:54,759 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1536): Joined the cluster in 130 msec 2023-07-15 21:10:54,799 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,36465,1689455450507-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-15 21:10:54,799 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,36465,1689455450507-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-07-15 21:10:54,799 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,36465,1689455450507-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-07-15 21:10:54,801 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase4:36465, period=300000, unit=MILLISECONDS is enabled. 2023-07-15 21:10:54,802 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-07-15 21:10:54,812 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2023-07-15 21:10:54,828 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-07-15 21:10:54,829 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2148): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-07-15 21:10:54,843 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-07-15 21:10:54,846 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-07-15 21:10:54,849 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-15 21:10:54,875 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/.tmp/data/hbase/namespace/1b0dd1d2541fcb6773c416eff63248c3 2023-07-15 21:10:54,878 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/.tmp/data/hbase/namespace/1b0dd1d2541fcb6773c416eff63248c3 empty. 2023-07-15 21:10:54,880 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/.tmp/data/hbase/namespace/1b0dd1d2541fcb6773c416eff63248c3 2023-07-15 21:10:54,880 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-07-15 21:10:54,932 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-07-15 21:10:54,935 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7675): creating {ENCODED => 1b0dd1d2541fcb6773c416eff63248c3, NAME => 'hbase:namespace,,1689455454829.1b0dd1d2541fcb6773c416eff63248c3.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/.tmp 2023-07-15 21:10:54,956 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1689455454829.1b0dd1d2541fcb6773c416eff63248c3.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-15 21:10:54,956 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1604): Closing 1b0dd1d2541fcb6773c416eff63248c3, disabling compactions & flushes 2023-07-15 21:10:54,956 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1689455454829.1b0dd1d2541fcb6773c416eff63248c3. 2023-07-15 21:10:54,956 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1689455454829.1b0dd1d2541fcb6773c416eff63248c3. 2023-07-15 21:10:54,956 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1689455454829.1b0dd1d2541fcb6773c416eff63248c3. after waiting 0 ms 2023-07-15 21:10:54,956 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1689455454829.1b0dd1d2541fcb6773c416eff63248c3. 2023-07-15 21:10:54,956 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1838): Closed hbase:namespace,,1689455454829.1b0dd1d2541fcb6773c416eff63248c3. 2023-07-15 21:10:54,957 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1558): Region close journal for 1b0dd1d2541fcb6773c416eff63248c3: 2023-07-15 21:10:54,962 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-07-15 21:10:54,981 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1689455454829.1b0dd1d2541fcb6773c416eff63248c3.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1689455454966"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689455454966"}]},"ts":"1689455454966"} 2023-07-15 21:10:55,015 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-07-15 21:10:55,017 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-15 21:10:55,021 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689455455017"}]},"ts":"1689455455017"} 2023-07-15 21:10:55,026 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-07-15 21:10:55,031 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-15 21:10:55,033 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-15 21:10:55,033 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-15 21:10:55,033 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-15 21:10:55,033 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-15 21:10:55,035 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=1b0dd1d2541fcb6773c416eff63248c3, ASSIGN}] 2023-07-15 21:10:55,038 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=1b0dd1d2541fcb6773c416eff63248c3, ASSIGN 2023-07-15 21:10:55,040 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=1b0dd1d2541fcb6773c416eff63248c3, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,39587,1689455451998; forceNewPlan=false, retain=false 2023-07-15 21:10:55,197 INFO [jenkins-hbase4:36465] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-07-15 21:10:55,198 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=1b0dd1d2541fcb6773c416eff63248c3, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,39587,1689455451998 2023-07-15 21:10:55,198 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1689455454829.1b0dd1d2541fcb6773c416eff63248c3.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1689455455198"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689455455198"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689455455198"}]},"ts":"1689455455198"} 2023-07-15 21:10:55,203 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure 1b0dd1d2541fcb6773c416eff63248c3, server=jenkins-hbase4.apache.org,39587,1689455451998}] 2023-07-15 21:10:55,358 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,39587,1689455451998 2023-07-15 21:10:55,358 DEBUG [RSProcedureDispatcher-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-15 21:10:55,362 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:58116, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-15 21:10:55,369 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:namespace,,1689455454829.1b0dd1d2541fcb6773c416eff63248c3. 2023-07-15 21:10:55,369 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1b0dd1d2541fcb6773c416eff63248c3, NAME => 'hbase:namespace,,1689455454829.1b0dd1d2541fcb6773c416eff63248c3.', STARTKEY => '', ENDKEY => ''} 2023-07-15 21:10:55,370 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:namespace,,1689455454829.1b0dd1d2541fcb6773c416eff63248c3. service=AccessControlService 2023-07-15 21:10:55,370 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-15 21:10:55,371 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace 1b0dd1d2541fcb6773c416eff63248c3 2023-07-15 21:10:55,371 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1689455454829.1b0dd1d2541fcb6773c416eff63248c3.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-15 21:10:55,371 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 1b0dd1d2541fcb6773c416eff63248c3 2023-07-15 21:10:55,371 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 1b0dd1d2541fcb6773c416eff63248c3 2023-07-15 21:10:55,373 INFO [StoreOpener-1b0dd1d2541fcb6773c416eff63248c3-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1b0dd1d2541fcb6773c416eff63248c3 2023-07-15 21:10:55,376 DEBUG [StoreOpener-1b0dd1d2541fcb6773c416eff63248c3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/data/hbase/namespace/1b0dd1d2541fcb6773c416eff63248c3/info 2023-07-15 21:10:55,376 DEBUG [StoreOpener-1b0dd1d2541fcb6773c416eff63248c3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/data/hbase/namespace/1b0dd1d2541fcb6773c416eff63248c3/info 2023-07-15 21:10:55,376 INFO [StoreOpener-1b0dd1d2541fcb6773c416eff63248c3-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1b0dd1d2541fcb6773c416eff63248c3 columnFamilyName info 2023-07-15 21:10:55,377 INFO [StoreOpener-1b0dd1d2541fcb6773c416eff63248c3-1] regionserver.HStore(310): Store=1b0dd1d2541fcb6773c416eff63248c3/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-15 21:10:55,379 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/data/hbase/namespace/1b0dd1d2541fcb6773c416eff63248c3 2023-07-15 21:10:55,380 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/data/hbase/namespace/1b0dd1d2541fcb6773c416eff63248c3 2023-07-15 21:10:55,389 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 1b0dd1d2541fcb6773c416eff63248c3 2023-07-15 21:10:55,393 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/data/hbase/namespace/1b0dd1d2541fcb6773c416eff63248c3/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-15 21:10:55,394 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 1b0dd1d2541fcb6773c416eff63248c3; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64599416, jitterRate=-0.03739368915557861}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-15 21:10:55,394 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 1b0dd1d2541fcb6773c416eff63248c3: 2023-07-15 21:10:55,396 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:namespace,,1689455454829.1b0dd1d2541fcb6773c416eff63248c3., pid=6, masterSystemTime=1689455455358 2023-07-15 21:10:55,401 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:namespace,,1689455454829.1b0dd1d2541fcb6773c416eff63248c3. 2023-07-15 21:10:55,402 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:namespace,,1689455454829.1b0dd1d2541fcb6773c416eff63248c3. 2023-07-15 21:10:55,403 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=1b0dd1d2541fcb6773c416eff63248c3, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,39587,1689455451998 2023-07-15 21:10:55,404 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1689455454829.1b0dd1d2541fcb6773c416eff63248c3.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1689455455403"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689455455403"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689455455403"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689455455403"}]},"ts":"1689455455403"} 2023-07-15 21:10:55,411 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-07-15 21:10:55,411 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure 1b0dd1d2541fcb6773c416eff63248c3, server=jenkins-hbase4.apache.org,39587,1689455451998 in 204 msec 2023-07-15 21:10:55,416 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-07-15 21:10:55,417 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=1b0dd1d2541fcb6773c416eff63248c3, ASSIGN in 376 msec 2023-07-15 21:10:55,418 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-15 21:10:55,418 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689455455418"}]},"ts":"1689455455418"} 2023-07-15 21:10:55,421 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-07-15 21:10:55,431 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-07-15 21:10:55,435 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 600 msec 2023-07-15 21:10:55,446 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:36465-0x1016ad2d8bb0000, quorum=127.0.0.1:50024, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-07-15 21:10:55,448 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): master:36465-0x1016ad2d8bb0000, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-07-15 21:10:55,448 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): master:36465-0x1016ad2d8bb0000, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-15 21:10:55,474 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-15 21:10:55,477 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:58128, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-15 21:10:55,493 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-07-15 21:10:55,512 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): master:36465-0x1016ad2d8bb0000, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-07-15 21:10:55,518 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 34 msec 2023-07-15 21:10:55,528 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-07-15 21:10:55,540 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): master:36465-0x1016ad2d8bb0000, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-07-15 21:10:55,546 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 18 msec 2023-07-15 21:10:55,554 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): master:36465-0x1016ad2d8bb0000, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-07-15 21:10:55,558 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): master:36465-0x1016ad2d8bb0000, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-07-15 21:10:55,559 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1083): Master has completed initialization 3.441sec 2023-07-15 21:10:55,562 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-07-15 21:10:55,564 INFO [master/jenkins-hbase4:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-07-15 21:10:55,564 INFO [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-07-15 21:10:55,565 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,36465,1689455450507-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-07-15 21:10:55,566 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,36465,1689455450507-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-07-15 21:10:55,589 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster$4(2112): Client=null/null create 'hbase:acl', {NAME => 'l', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-07-15 21:10:55,591 DEBUG [Listener at localhost/43845] zookeeper.ReadOnlyZKClient(139): Connect 0x0a248d85 to 127.0.0.1:50024 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-15 21:10:55,591 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:acl 2023-07-15 21:10:55,595 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_PRE_OPERATION 2023-07-15 21:10:55,597 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-15 21:10:55,601 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(700): Client=null/null procedure request for creating table: namespace: "hbase" qualifier: "acl" procId is: 9 2023-07-15 21:10:55,603 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/.tmp/data/hbase/acl/53946c1aed1c923485e0abe3a27a9e59 2023-07-15 21:10:55,603 DEBUG [Listener at localhost/43845] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@31248683, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-15 21:10:55,604 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/.tmp/data/hbase/acl/53946c1aed1c923485e0abe3a27a9e59 empty. 2023-07-15 21:10:55,608 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/.tmp/data/hbase/acl/53946c1aed1c923485e0abe3a27a9e59 2023-07-15 21:10:55,608 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived hbase:acl regions 2023-07-15 21:10:55,614 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-15 21:10:55,621 DEBUG [hconnection-0x15927c21-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-15 21:10:55,638 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/.tmp/data/hbase/acl/.tabledesc/.tableinfo.0000000001 2023-07-15 21:10:55,648 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(7675): creating {ENCODED => 53946c1aed1c923485e0abe3a27a9e59, NAME => 'hbase:acl,,1689455455584.53946c1aed1c923485e0abe3a27a9e59.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:acl', {NAME => 'l', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/.tmp 2023-07-15 21:10:55,648 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:44018, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-15 21:10:55,651 INFO [Listener at localhost/43845] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase4.apache.org,36465,1689455450507 2023-07-15 21:10:55,655 INFO [Listener at localhost/43845] hbase.HBaseTestingUtility(2699): Starting mini mapreduce cluster... 2023-07-15 21:10:55,655 INFO [Listener at localhost/43845] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/de3e87f0-08fc-c0d0-c969-4c410fd4e6fd/test.cache.data in system properties and HBase conf 2023-07-15 21:10:55,655 INFO [Listener at localhost/43845] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/de3e87f0-08fc-c0d0-c969-4c410fd4e6fd/hadoop.tmp.dir in system properties and HBase conf 2023-07-15 21:10:55,655 INFO [Listener at localhost/43845] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/de3e87f0-08fc-c0d0-c969-4c410fd4e6fd/hadoop.log.dir in system properties and HBase conf 2023-07-15 21:10:55,656 INFO [Listener at localhost/43845] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/de3e87f0-08fc-c0d0-c969-4c410fd4e6fd/mapreduce.cluster.local.dir in system properties and HBase conf 2023-07-15 21:10:55,656 INFO [Listener at localhost/43845] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/de3e87f0-08fc-c0d0-c969-4c410fd4e6fd/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-07-15 21:10:55,656 INFO [Listener at localhost/43845] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-07-15 21:10:55,656 INFO [Listener at localhost/43845] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/de3e87f0-08fc-c0d0-c969-4c410fd4e6fd/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-07-15 21:10:55,657 INFO [Listener at localhost/43845] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/de3e87f0-08fc-c0d0-c969-4c410fd4e6fd/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-07-15 21:10:55,657 INFO [Listener at localhost/43845] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/de3e87f0-08fc-c0d0-c969-4c410fd4e6fd/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-07-15 21:10:55,657 INFO [Listener at localhost/43845] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/de3e87f0-08fc-c0d0-c969-4c410fd4e6fd/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-15 21:10:55,657 INFO [Listener at localhost/43845] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/de3e87f0-08fc-c0d0-c969-4c410fd4e6fd/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-07-15 21:10:55,657 INFO [Listener at localhost/43845] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/de3e87f0-08fc-c0d0-c969-4c410fd4e6fd/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-07-15 21:10:55,657 INFO [Listener at localhost/43845] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/de3e87f0-08fc-c0d0-c969-4c410fd4e6fd/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-15 21:10:55,657 INFO [Listener at localhost/43845] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/de3e87f0-08fc-c0d0-c969-4c410fd4e6fd/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-15 21:10:55,657 INFO [Listener at localhost/43845] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/de3e87f0-08fc-c0d0-c969-4c410fd4e6fd/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-07-15 21:10:55,658 INFO [Listener at localhost/43845] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/de3e87f0-08fc-c0d0-c969-4c410fd4e6fd/nfs.dump.dir in system properties and HBase conf 2023-07-15 21:10:55,658 INFO [Listener at localhost/43845] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/de3e87f0-08fc-c0d0-c969-4c410fd4e6fd/java.io.tmpdir in system properties and HBase conf 2023-07-15 21:10:55,658 INFO [Listener at localhost/43845] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/de3e87f0-08fc-c0d0-c969-4c410fd4e6fd/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-15 21:10:55,659 INFO [Listener at localhost/43845] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/de3e87f0-08fc-c0d0-c969-4c410fd4e6fd/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-07-15 21:10:55,659 INFO [Listener at localhost/43845] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/de3e87f0-08fc-c0d0-c969-4c410fd4e6fd/fs.s3a.committer.staging.tmp.path in system properties and HBase conf 2023-07-15 21:10:55,685 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(866): Instantiated hbase:acl,,1689455455584.53946c1aed1c923485e0abe3a27a9e59.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-15 21:10:55,685 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1604): Closing 53946c1aed1c923485e0abe3a27a9e59, disabling compactions & flushes 2023-07-15 21:10:55,685 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1626): Closing region hbase:acl,,1689455455584.53946c1aed1c923485e0abe3a27a9e59. 2023-07-15 21:10:55,685 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:acl,,1689455455584.53946c1aed1c923485e0abe3a27a9e59. 2023-07-15 21:10:55,685 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:acl,,1689455455584.53946c1aed1c923485e0abe3a27a9e59. after waiting 0 ms 2023-07-15 21:10:55,685 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:acl,,1689455455584.53946c1aed1c923485e0abe3a27a9e59. 2023-07-15 21:10:55,685 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1838): Closed hbase:acl,,1689455455584.53946c1aed1c923485e0abe3a27a9e59. 2023-07-15 21:10:55,685 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1558): Region close journal for 53946c1aed1c923485e0abe3a27a9e59: 2023-07-15 21:10:55,690 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_ADD_TO_META 2023-07-15 21:10:55,692 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:acl,,1689455455584.53946c1aed1c923485e0abe3a27a9e59.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1689455455692"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689455455692"}]},"ts":"1689455455692"} 2023-07-15 21:10:55,695 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-07-15 21:10:55,697 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-15 21:10:55,697 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:acl","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689455455697"}]},"ts":"1689455455697"} 2023-07-15 21:10:55,700 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=hbase:acl, state=ENABLING in hbase:meta 2023-07-15 21:10:55,706 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-15 21:10:55,708 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-15 21:10:55,708 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-15 21:10:55,708 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-15 21:10:55,708 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-15 21:10:55,708 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:acl, region=53946c1aed1c923485e0abe3a27a9e59, ASSIGN}] 2023-07-15 21:10:55,712 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:acl, region=53946c1aed1c923485e0abe3a27a9e59, ASSIGN 2023-07-15 21:10:55,715 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:acl, region=53946c1aed1c923485e0abe3a27a9e59, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,39075,1689455452043; forceNewPlan=false, retain=false 2023-07-15 21:10:55,719 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-15 21:10:55,865 INFO [jenkins-hbase4:36465] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-07-15 21:10:55,866 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=53946c1aed1c923485e0abe3a27a9e59, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,39075,1689455452043 2023-07-15 21:10:55,867 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:acl,,1689455455584.53946c1aed1c923485e0abe3a27a9e59.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1689455455866"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689455455866"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689455455866"}]},"ts":"1689455455866"} 2023-07-15 21:10:55,870 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE; OpenRegionProcedure 53946c1aed1c923485e0abe3a27a9e59, server=jenkins-hbase4.apache.org,39075,1689455452043}] 2023-07-15 21:10:55,920 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-15 21:10:56,047 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:acl,,1689455455584.53946c1aed1c923485e0abe3a27a9e59. 2023-07-15 21:10:56,048 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 53946c1aed1c923485e0abe3a27a9e59, NAME => 'hbase:acl,,1689455455584.53946c1aed1c923485e0abe3a27a9e59.', STARTKEY => '', ENDKEY => ''} 2023-07-15 21:10:56,048 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:acl,,1689455455584.53946c1aed1c923485e0abe3a27a9e59. service=AccessControlService 2023-07-15 21:10:56,048 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-15 21:10:56,048 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table acl 53946c1aed1c923485e0abe3a27a9e59 2023-07-15 21:10:56,048 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:acl,,1689455455584.53946c1aed1c923485e0abe3a27a9e59.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-15 21:10:56,048 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 53946c1aed1c923485e0abe3a27a9e59 2023-07-15 21:10:56,048 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 53946c1aed1c923485e0abe3a27a9e59 2023-07-15 21:10:56,051 INFO [StoreOpener-53946c1aed1c923485e0abe3a27a9e59-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family l of region 53946c1aed1c923485e0abe3a27a9e59 2023-07-15 21:10:56,055 DEBUG [StoreOpener-53946c1aed1c923485e0abe3a27a9e59-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/data/hbase/acl/53946c1aed1c923485e0abe3a27a9e59/l 2023-07-15 21:10:56,055 DEBUG [StoreOpener-53946c1aed1c923485e0abe3a27a9e59-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/data/hbase/acl/53946c1aed1c923485e0abe3a27a9e59/l 2023-07-15 21:10:56,055 INFO [StoreOpener-53946c1aed1c923485e0abe3a27a9e59-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 53946c1aed1c923485e0abe3a27a9e59 columnFamilyName l 2023-07-15 21:10:56,056 INFO [StoreOpener-53946c1aed1c923485e0abe3a27a9e59-1] regionserver.HStore(310): Store=53946c1aed1c923485e0abe3a27a9e59/l, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-15 21:10:56,061 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/data/hbase/acl/53946c1aed1c923485e0abe3a27a9e59 2023-07-15 21:10:56,062 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/data/hbase/acl/53946c1aed1c923485e0abe3a27a9e59 2023-07-15 21:10:56,073 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 53946c1aed1c923485e0abe3a27a9e59 2023-07-15 21:10:56,078 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/data/hbase/acl/53946c1aed1c923485e0abe3a27a9e59/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-15 21:10:56,081 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 53946c1aed1c923485e0abe3a27a9e59; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65566675, jitterRate=-0.022980406880378723}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-15 21:10:56,081 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 53946c1aed1c923485e0abe3a27a9e59: 2023-07-15 21:10:56,083 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:acl,,1689455455584.53946c1aed1c923485e0abe3a27a9e59., pid=11, masterSystemTime=1689455456031 2023-07-15 21:10:56,090 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:acl,,1689455455584.53946c1aed1c923485e0abe3a27a9e59. 2023-07-15 21:10:56,091 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:acl,,1689455455584.53946c1aed1c923485e0abe3a27a9e59. 2023-07-15 21:10:56,091 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=53946c1aed1c923485e0abe3a27a9e59, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,39075,1689455452043 2023-07-15 21:10:56,092 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:acl,,1689455455584.53946c1aed1c923485e0abe3a27a9e59.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1689455456091"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689455456091"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689455456091"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689455456091"}]},"ts":"1689455456091"} 2023-07-15 21:10:56,100 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=11, resume processing ppid=10 2023-07-15 21:10:56,100 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; OpenRegionProcedure 53946c1aed1c923485e0abe3a27a9e59, server=jenkins-hbase4.apache.org,39075,1689455452043 in 226 msec 2023-07-15 21:10:56,104 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=10, resume processing ppid=9 2023-07-15 21:10:56,104 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=10, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=hbase:acl, region=53946c1aed1c923485e0abe3a27a9e59, ASSIGN in 392 msec 2023-07-15 21:10:56,107 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-15 21:10:56,107 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:acl","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689455456107"}]},"ts":"1689455456107"} 2023-07-15 21:10:56,110 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:acl, state=ENABLED in hbase:meta 2023-07-15 21:10:56,114 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_POST_OPERATION 2023-07-15 21:10:56,117 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=9, state=SUCCESS; CreateTableProcedure table=hbase:acl in 525 msec 2023-07-15 21:10:56,220 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-15 21:10:56,220 INFO [master/jenkins-hbase4:0:becomeActiveMaster] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: hbase:acl, procId: 9 completed 2023-07-15 21:10:56,234 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1175): Balancer post startup initialization complete, took 0 seconds 2023-07-15 21:10:56,979 WARN [Thread-384] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-15 21:10:57,363 INFO [Thread-384] log.Slf4jLog(67): jetty-6.1.26 2023-07-15 21:10:57,369 INFO [Thread-384] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/jobhistory to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/de3e87f0-08fc-c0d0-c969-4c410fd4e6fd/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_44515_jobhistory____2hcd8i/webapp 2023-07-15 21:10:57,537 INFO [Thread-384] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.mapreduce.v2.hs.webapp.HsWebServices as a root resource class 2023-07-15 21:10:57,537 INFO [Thread-384] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.mapreduce.v2.hs.webapp.JAXBContextResolver as a provider class 2023-07-15 21:10:57,538 INFO [Thread-384] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-07-15 21:10:57,540 INFO [Thread-384] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-07-15 21:10:57,604 INFO [Thread-384] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.mapreduce.v2.hs.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-15 21:10:57,883 INFO [Thread-384] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-15 21:10:58,150 INFO [Thread-384] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.mapreduce.v2.hs.webapp.HsWebServices to GuiceManagedComponentProvider with the scope "PerRequest" 2023-07-15 21:10:58,196 INFO [Thread-384] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:44515 2023-07-15 21:10:58,474 WARN [Listener at jenkins-hbase4.apache.org/39087] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-15 21:10:58,821 WARN [Listener at jenkins-hbase4.apache.org/39087] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-07-15 21:10:58,822 INFO [Listener at jenkins-hbase4.apache.org/39087] log.Slf4jLog(67): jetty-6.1.26 2023-07-15 21:10:58,830 INFO [Listener at jenkins-hbase4.apache.org/39087] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/cluster to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/de3e87f0-08fc-c0d0-c969-4c410fd4e6fd/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_44823_cluster____.3m6tit/webapp 2023-07-15 21:10:58,950 INFO [Listener at jenkins-hbase4.apache.org/39087] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.resourcemanager.webapp.JAXBContextResolver as a provider class 2023-07-15 21:10:58,951 INFO [Listener at jenkins-hbase4.apache.org/39087] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.resourcemanager.webapp.RMWebServices as a root resource class 2023-07-15 21:10:58,951 INFO [Listener at jenkins-hbase4.apache.org/39087] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-07-15 21:10:58,951 INFO [Listener at jenkins-hbase4.apache.org/39087] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-07-15 21:10:58,961 INFO [Listener at jenkins-hbase4.apache.org/39087] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.resourcemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-15 21:10:59,224 INFO [Listener at jenkins-hbase4.apache.org/39087] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-15 21:10:59,372 INFO [Listener at jenkins-hbase4.apache.org/39087] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.resourcemanager.webapp.RMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-15 21:10:59,391 INFO [Listener at jenkins-hbase4.apache.org/39087] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:44823 2023-07-15 21:11:00,145 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-15 21:11:00,291 WARN [Listener at jenkins-hbase4.apache.org/42345] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-15 21:11:00,319 WARN [Listener at jenkins-hbase4.apache.org/42345] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-07-15 21:11:00,320 INFO [Listener at jenkins-hbase4.apache.org/42345] log.Slf4jLog(67): jetty-6.1.26 2023-07-15 21:11:00,325 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:namespace' 2023-07-15 21:11:00,327 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:meta' 2023-07-15 21:11:00,328 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:acl' 2023-07-15 21:11:00,344 INFO [Listener at jenkins-hbase4.apache.org/42345] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/node to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/de3e87f0-08fc-c0d0-c969-4c410fd4e6fd/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_40115_node____6ha63b/webapp 2023-07-15 21:11:00,423 INFO [Listener at jenkins-hbase4.apache.org/42345] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices as a root resource class 2023-07-15 21:11:00,423 INFO [Listener at jenkins-hbase4.apache.org/42345] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-07-15 21:11:00,423 INFO [Listener at jenkins-hbase4.apache.org/42345] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver as a provider class 2023-07-15 21:11:00,423 INFO [Listener at jenkins-hbase4.apache.org/42345] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-07-15 21:11:00,435 INFO [Listener at jenkins-hbase4.apache.org/42345] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-15 21:11:00,461 INFO [Listener at jenkins-hbase4.apache.org/42345] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-15 21:11:00,557 INFO [Listener at jenkins-hbase4.apache.org/42345] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-15 21:11:00,570 INFO [Listener at jenkins-hbase4.apache.org/42345] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:40115 2023-07-15 21:11:00,678 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.RegionServer.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-07-15 21:11:00,687 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.RegionServer.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase RegionServerObservers 2023-07-15 21:11:00,687 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-07-15 21:11:00,687 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase MasterObservers 2023-07-15 21:11:00,688 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver 2023-07-15 21:11:00,688 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver Metrics about HBase MasterObservers 2023-07-15 21:11:00,688 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-07-15 21:11:00,688 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase RegionObservers 2023-07-15 21:11:00,688 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-07-15 21:11:00,688 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint Metrics about HBase RegionObservers 2023-07-15 21:11:00,828 WARN [Listener at jenkins-hbase4.apache.org/41711] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-15 21:11:00,834 WARN [Listener at jenkins-hbase4.apache.org/41711] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-07-15 21:11:00,835 INFO [Listener at jenkins-hbase4.apache.org/41711] log.Slf4jLog(67): jetty-6.1.26 2023-07-15 21:11:00,840 INFO [Listener at jenkins-hbase4.apache.org/41711] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/node to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/de3e87f0-08fc-c0d0-c969-4c410fd4e6fd/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_45333_node____b01xbk/webapp 2023-07-15 21:11:00,891 INFO [Listener at jenkins-hbase4.apache.org/41711] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices as a root resource class 2023-07-15 21:11:00,891 INFO [Listener at jenkins-hbase4.apache.org/41711] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-07-15 21:11:00,891 INFO [Listener at jenkins-hbase4.apache.org/41711] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver as a provider class 2023-07-15 21:11:00,891 INFO [Listener at jenkins-hbase4.apache.org/41711] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-07-15 21:11:00,901 INFO [Listener at jenkins-hbase4.apache.org/41711] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-15 21:11:00,913 INFO [Listener at jenkins-hbase4.apache.org/41711] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-15 21:11:01,014 INFO [Listener at jenkins-hbase4.apache.org/41711] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-15 21:11:01,023 INFO [Listener at jenkins-hbase4.apache.org/41711] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:45333 2023-07-15 21:11:01,063 INFO [Listener at jenkins-hbase4.apache.org/41711] hbase.HBaseTestingUtility(2726): Mini mapreduce cluster started 2023-07-15 21:11:01,065 INFO [Listener at jenkins-hbase4.apache.org/41711] hbase.Waiter(180): Waiting up to [30,000] milli-secs(wait.for.ratio=[1]) 2023-07-15 21:11:01,143 INFO [Listener at jenkins-hbase4.apache.org/41711] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportWithTargetName Thread=706, OpenFileDescriptor=903, MaxFileDescriptor=60000, SystemLoadAverage=293, ProcessCount=174, AvailableMemoryMB=4847 2023-07-15 21:11:01,143 WARN [Listener at jenkins-hbase4.apache.org/41711] hbase.ResourceChecker(130): Thread=706 is superior to 500 2023-07-15 21:11:01,161 DEBUG [Listener at jenkins-hbase4.apache.org/41711] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-07-15 21:11:01,169 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:60136, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-07-15 21:11:01,179 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36465] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-07-15 21:11:01,182 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36465] procedure2.ProcedureExecutor(1029): Stored pid=12, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportWithTargetName 2023-07-15 21:11:01,185 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_PRE_OPERATION 2023-07-15 21:11:01,186 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36465] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportWithTargetName" procId is: 12 2023-07-15 21:11:01,189 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-15 21:11:01,190 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36465] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-15 21:11:01,195 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/.tmp/data/default/testtb-testExportWithTargetName/02d9b37da6522e108c062b61df6e3707 2023-07-15 21:11:01,196 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/.tmp/data/default/testtb-testExportWithTargetName/02d9b37da6522e108c062b61df6e3707 empty. 2023-07-15 21:11:01,198 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/.tmp/data/default/testtb-testExportWithTargetName/02d9b37da6522e108c062b61df6e3707 2023-07-15 21:11:01,198 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/.tmp/data/default/testtb-testExportWithTargetName/7d9eedcece667f4c6074fc0931e96f3a 2023-07-15 21:11:01,199 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/.tmp/data/default/testtb-testExportWithTargetName/7d9eedcece667f4c6074fc0931e96f3a empty. 2023-07-15 21:11:01,201 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/.tmp/data/default/testtb-testExportWithTargetName/7d9eedcece667f4c6074fc0931e96f3a 2023-07-15 21:11:01,201 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testExportWithTargetName regions 2023-07-15 21:11:01,235 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/.tmp/data/default/testtb-testExportWithTargetName/.tabledesc/.tableinfo.0000000001 2023-07-15 21:11:01,238 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(7675): creating {ENCODED => 02d9b37da6522e108c062b61df6e3707, NAME => 'testtb-testExportWithTargetName,,1689455461178.02d9b37da6522e108c062b61df6e3707.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/.tmp 2023-07-15 21:11:01,238 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(7675): creating {ENCODED => 7d9eedcece667f4c6074fc0931e96f3a, NAME => 'testtb-testExportWithTargetName,1,1689455461178.7d9eedcece667f4c6074fc0931e96f3a.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/.tmp 2023-07-15 21:11:01,280 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,,1689455461178.02d9b37da6522e108c062b61df6e3707.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-15 21:11:01,281 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1604): Closing 02d9b37da6522e108c062b61df6e3707, disabling compactions & flushes 2023-07-15 21:11:01,281 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,,1689455461178.02d9b37da6522e108c062b61df6e3707. 2023-07-15 21:11:01,281 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,,1689455461178.02d9b37da6522e108c062b61df6e3707. 2023-07-15 21:11:01,281 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,,1689455461178.02d9b37da6522e108c062b61df6e3707. after waiting 0 ms 2023-07-15 21:11:01,281 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,1,1689455461178.7d9eedcece667f4c6074fc0931e96f3a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-15 21:11:01,281 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,,1689455461178.02d9b37da6522e108c062b61df6e3707. 2023-07-15 21:11:01,282 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1604): Closing 7d9eedcece667f4c6074fc0931e96f3a, disabling compactions & flushes 2023-07-15 21:11:01,282 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,,1689455461178.02d9b37da6522e108c062b61df6e3707. 2023-07-15 21:11:01,282 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,1,1689455461178.7d9eedcece667f4c6074fc0931e96f3a. 2023-07-15 21:11:01,282 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1558): Region close journal for 02d9b37da6522e108c062b61df6e3707: 2023-07-15 21:11:01,282 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,1,1689455461178.7d9eedcece667f4c6074fc0931e96f3a. 2023-07-15 21:11:01,282 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,1,1689455461178.7d9eedcece667f4c6074fc0931e96f3a. after waiting 0 ms 2023-07-15 21:11:01,282 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,1,1689455461178.7d9eedcece667f4c6074fc0931e96f3a. 2023-07-15 21:11:01,282 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,1,1689455461178.7d9eedcece667f4c6074fc0931e96f3a. 2023-07-15 21:11:01,282 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1558): Region close journal for 7d9eedcece667f4c6074fc0931e96f3a: 2023-07-15 21:11:01,287 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_ADD_TO_META 2023-07-15 21:11:01,288 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,,1689455461178.02d9b37da6522e108c062b61df6e3707.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689455461288"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689455461288"}]},"ts":"1689455461288"} 2023-07-15 21:11:01,288 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,1,1689455461178.7d9eedcece667f4c6074fc0931e96f3a.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689455461288"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689455461288"}]},"ts":"1689455461288"} 2023-07-15 21:11:01,293 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36465] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-15 21:11:01,337 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-15 21:11:01,339 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-15 21:11:01,339 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689455461339"}]},"ts":"1689455461339"} 2023-07-15 21:11:01,341 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=ENABLING in hbase:meta 2023-07-15 21:11:01,347 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-15 21:11:01,349 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-15 21:11:01,349 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-15 21:11:01,349 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-15 21:11:01,349 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-15 21:11:01,349 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=02d9b37da6522e108c062b61df6e3707, ASSIGN}, {pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=7d9eedcece667f4c6074fc0931e96f3a, ASSIGN}] 2023-07-15 21:11:01,352 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=02d9b37da6522e108c062b61df6e3707, ASSIGN 2023-07-15 21:11:01,352 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=7d9eedcece667f4c6074fc0931e96f3a, ASSIGN 2023-07-15 21:11:01,355 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=7d9eedcece667f4c6074fc0931e96f3a, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,39587,1689455451998; forceNewPlan=false, retain=false 2023-07-15 21:11:01,355 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=02d9b37da6522e108c062b61df6e3707, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,39075,1689455452043; forceNewPlan=false, retain=false 2023-07-15 21:11:01,495 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36465] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-15 21:11:01,505 INFO [jenkins-hbase4:36465] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-15 21:11:01,508 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=7d9eedcece667f4c6074fc0931e96f3a, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,39587,1689455451998 2023-07-15 21:11:01,508 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=02d9b37da6522e108c062b61df6e3707, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,39075,1689455452043 2023-07-15 21:11:01,508 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,1,1689455461178.7d9eedcece667f4c6074fc0931e96f3a.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689455461507"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689455461507"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689455461507"}]},"ts":"1689455461507"} 2023-07-15 21:11:01,508 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,,1689455461178.02d9b37da6522e108c062b61df6e3707.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689455461507"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689455461507"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689455461507"}]},"ts":"1689455461507"} 2023-07-15 21:11:01,511 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=15, ppid=14, state=RUNNABLE; OpenRegionProcedure 7d9eedcece667f4c6074fc0931e96f3a, server=jenkins-hbase4.apache.org,39587,1689455451998}] 2023-07-15 21:11:01,512 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=16, ppid=13, state=RUNNABLE; OpenRegionProcedure 02d9b37da6522e108c062b61df6e3707, server=jenkins-hbase4.apache.org,39075,1689455452043}] 2023-07-15 21:11:01,680 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportWithTargetName,1,1689455461178.7d9eedcece667f4c6074fc0931e96f3a. 2023-07-15 21:11:01,680 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportWithTargetName,,1689455461178.02d9b37da6522e108c062b61df6e3707. 2023-07-15 21:11:01,680 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 7d9eedcece667f4c6074fc0931e96f3a, NAME => 'testtb-testExportWithTargetName,1,1689455461178.7d9eedcece667f4c6074fc0931e96f3a.', STARTKEY => '1', ENDKEY => ''} 2023-07-15 21:11:01,680 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 02d9b37da6522e108c062b61df6e3707, NAME => 'testtb-testExportWithTargetName,,1689455461178.02d9b37da6522e108c062b61df6e3707.', STARTKEY => '', ENDKEY => '1'} 2023-07-15 21:11:01,681 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportWithTargetName,1,1689455461178.7d9eedcece667f4c6074fc0931e96f3a. service=AccessControlService 2023-07-15 21:11:01,681 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportWithTargetName,,1689455461178.02d9b37da6522e108c062b61df6e3707. service=AccessControlService 2023-07-15 21:11:01,681 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-15 21:11:01,681 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-15 21:11:01,681 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportWithTargetName 7d9eedcece667f4c6074fc0931e96f3a 2023-07-15 21:11:01,681 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportWithTargetName 02d9b37da6522e108c062b61df6e3707 2023-07-15 21:11:01,681 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,1,1689455461178.7d9eedcece667f4c6074fc0931e96f3a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-15 21:11:01,681 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,,1689455461178.02d9b37da6522e108c062b61df6e3707.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-15 21:11:01,681 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 7d9eedcece667f4c6074fc0931e96f3a 2023-07-15 21:11:01,682 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 02d9b37da6522e108c062b61df6e3707 2023-07-15 21:11:01,682 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 7d9eedcece667f4c6074fc0931e96f3a 2023-07-15 21:11:01,682 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 02d9b37da6522e108c062b61df6e3707 2023-07-15 21:11:01,688 INFO [StoreOpener-02d9b37da6522e108c062b61df6e3707-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 02d9b37da6522e108c062b61df6e3707 2023-07-15 21:11:01,688 INFO [StoreOpener-7d9eedcece667f4c6074fc0931e96f3a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 7d9eedcece667f4c6074fc0931e96f3a 2023-07-15 21:11:01,691 DEBUG [StoreOpener-02d9b37da6522e108c062b61df6e3707-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/data/default/testtb-testExportWithTargetName/02d9b37da6522e108c062b61df6e3707/cf 2023-07-15 21:11:01,691 DEBUG [StoreOpener-02d9b37da6522e108c062b61df6e3707-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/data/default/testtb-testExportWithTargetName/02d9b37da6522e108c062b61df6e3707/cf 2023-07-15 21:11:01,693 DEBUG [StoreOpener-7d9eedcece667f4c6074fc0931e96f3a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/data/default/testtb-testExportWithTargetName/7d9eedcece667f4c6074fc0931e96f3a/cf 2023-07-15 21:11:01,693 DEBUG [StoreOpener-7d9eedcece667f4c6074fc0931e96f3a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/data/default/testtb-testExportWithTargetName/7d9eedcece667f4c6074fc0931e96f3a/cf 2023-07-15 21:11:01,696 INFO [StoreOpener-02d9b37da6522e108c062b61df6e3707-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 02d9b37da6522e108c062b61df6e3707 columnFamilyName cf 2023-07-15 21:11:01,696 INFO [StoreOpener-7d9eedcece667f4c6074fc0931e96f3a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 7d9eedcece667f4c6074fc0931e96f3a columnFamilyName cf 2023-07-15 21:11:01,700 INFO [StoreOpener-02d9b37da6522e108c062b61df6e3707-1] regionserver.HStore(310): Store=02d9b37da6522e108c062b61df6e3707/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-15 21:11:01,702 INFO [StoreOpener-7d9eedcece667f4c6074fc0931e96f3a-1] regionserver.HStore(310): Store=7d9eedcece667f4c6074fc0931e96f3a/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-15 21:11:01,708 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/data/default/testtb-testExportWithTargetName/7d9eedcece667f4c6074fc0931e96f3a 2023-07-15 21:11:01,710 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/data/default/testtb-testExportWithTargetName/7d9eedcece667f4c6074fc0931e96f3a 2023-07-15 21:11:01,716 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 7d9eedcece667f4c6074fc0931e96f3a 2023-07-15 21:11:01,717 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/data/default/testtb-testExportWithTargetName/02d9b37da6522e108c062b61df6e3707 2023-07-15 21:11:01,718 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/data/default/testtb-testExportWithTargetName/02d9b37da6522e108c062b61df6e3707 2023-07-15 21:11:01,724 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/data/default/testtb-testExportWithTargetName/7d9eedcece667f4c6074fc0931e96f3a/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-15 21:11:01,726 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 7d9eedcece667f4c6074fc0931e96f3a; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62557481, jitterRate=-0.06782089173793793}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-15 21:11:01,726 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 7d9eedcece667f4c6074fc0931e96f3a: 2023-07-15 21:11:01,727 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportWithTargetName,1,1689455461178.7d9eedcece667f4c6074fc0931e96f3a., pid=15, masterSystemTime=1689455461665 2023-07-15 21:11:01,732 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportWithTargetName,1,1689455461178.7d9eedcece667f4c6074fc0931e96f3a. 2023-07-15 21:11:01,732 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportWithTargetName,1,1689455461178.7d9eedcece667f4c6074fc0931e96f3a. 2023-07-15 21:11:01,732 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=7d9eedcece667f4c6074fc0931e96f3a, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,39587,1689455451998 2023-07-15 21:11:01,733 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportWithTargetName,1,1689455461178.7d9eedcece667f4c6074fc0931e96f3a.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689455461732"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689455461732"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689455461732"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689455461732"}]},"ts":"1689455461732"} 2023-07-15 21:11:01,738 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 02d9b37da6522e108c062b61df6e3707 2023-07-15 21:11:01,739 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=15, resume processing ppid=14 2023-07-15 21:11:01,741 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=15, ppid=14, state=SUCCESS; OpenRegionProcedure 7d9eedcece667f4c6074fc0931e96f3a, server=jenkins-hbase4.apache.org,39587,1689455451998 in 224 msec 2023-07-15 21:11:01,743 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/data/default/testtb-testExportWithTargetName/02d9b37da6522e108c062b61df6e3707/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-15 21:11:01,743 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=14, ppid=12, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=7d9eedcece667f4c6074fc0931e96f3a, ASSIGN in 390 msec 2023-07-15 21:11:01,744 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 02d9b37da6522e108c062b61df6e3707; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68743547, jitterRate=0.024358674883842468}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-15 21:11:01,744 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 02d9b37da6522e108c062b61df6e3707: 2023-07-15 21:11:01,745 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportWithTargetName,,1689455461178.02d9b37da6522e108c062b61df6e3707., pid=16, masterSystemTime=1689455461668 2023-07-15 21:11:01,747 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportWithTargetName,,1689455461178.02d9b37da6522e108c062b61df6e3707. 2023-07-15 21:11:01,748 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportWithTargetName,,1689455461178.02d9b37da6522e108c062b61df6e3707. 2023-07-15 21:11:01,748 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=02d9b37da6522e108c062b61df6e3707, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,39075,1689455452043 2023-07-15 21:11:01,748 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportWithTargetName,,1689455461178.02d9b37da6522e108c062b61df6e3707.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689455461748"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689455461748"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689455461748"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689455461748"}]},"ts":"1689455461748"} 2023-07-15 21:11:01,753 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=16, resume processing ppid=13 2023-07-15 21:11:01,753 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=13, state=SUCCESS; OpenRegionProcedure 02d9b37da6522e108c062b61df6e3707, server=jenkins-hbase4.apache.org,39075,1689455452043 in 239 msec 2023-07-15 21:11:01,756 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=13, resume processing ppid=12 2023-07-15 21:11:01,757 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=13, ppid=12, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=02d9b37da6522e108c062b61df6e3707, ASSIGN in 404 msec 2023-07-15 21:11:01,758 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-15 21:11:01,759 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689455461759"}]},"ts":"1689455461759"} 2023-07-15 21:11:01,761 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=ENABLED in hbase:meta 2023-07-15 21:11:01,764 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_POST_OPERATION 2023-07-15 21:11:01,770 DEBUG [PEWorker-5] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportWithTargetName jenkins: RWXCA 2023-07-15 21:11:01,788 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=39075] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-07-15 21:11:01,796 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36465] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-15 21:11:01,823 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): regionserver:39075-0x1016ad2d8bb0003, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-15 21:11:01,824 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): regionserver:39587-0x1016ad2d8bb0002, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-15 21:11:01,823 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): master:36465-0x1016ad2d8bb0000, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-15 21:11:01,824 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): master:36465-0x1016ad2d8bb0000, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-15 21:11:01,823 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): regionserver:37853-0x1016ad2d8bb0001, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-15 21:11:01,831 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): regionserver:37853-0x1016ad2d8bb0001, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-15 21:11:01,831 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): master:36465-0x1016ad2d8bb0000, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-15 21:11:01,831 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-07-15 21:11:01,831 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-07-15 21:11:01,832 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-07-15 21:11:01,833 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-07-15 21:11:01,835 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=12, state=SUCCESS; CreateTableProcedure table=testtb-testExportWithTargetName in 653 msec 2023-07-15 21:11:02,298 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36465] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-15 21:11:02,299 INFO [Listener at jenkins-hbase4.apache.org/41711] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportWithTargetName, procId: 12 completed 2023-07-15 21:11:02,304 DEBUG [Listener at jenkins-hbase4.apache.org/41711] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportWithTargetName 2023-07-15 21:11:02,305 DEBUG [Listener at jenkins-hbase4.apache.org/41711] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportWithTargetName,,1689455461178.02d9b37da6522e108c062b61df6e3707. 2023-07-15 21:11:02,308 INFO [Listener at jenkins-hbase4.apache.org/41711] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-15 21:11:02,339 DEBUG [hconnection-0x15927c21-shared-pool-5] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-15 21:11:02,343 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:50118, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-15 21:11:02,365 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36465] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-15 21:11:02,365 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36465] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689455462365 (current time:1689455462365). 2023-07-15 21:11:02,365 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36465] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-15 21:11:02,365 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36465] zookeeper.ReadOnlyZKClient(139): Connect 0x7752379d to 127.0.0.1:50024 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-15 21:11:02,375 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36465] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4ff52e6, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-15 21:11:02,376 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36465] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-15 21:11:02,378 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:50950, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-15 21:11:02,379 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36465] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7752379d to 127.0.0.1:50024 2023-07-15 21:11:02,379 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36465] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-15 21:11:02,381 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36465] zookeeper.ReadOnlyZKClient(139): Connect 0x124f8b69 to 127.0.0.1:50024 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-15 21:11:02,391 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36465] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@58009b82, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-15 21:11:02,393 DEBUG [hconnection-0x5cec288c-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-15 21:11:02,396 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:50958, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-15 21:11:02,401 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36465] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x124f8b69 to 127.0.0.1:50024 2023-07-15 21:11:02,401 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36465] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-15 21:11:02,401 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36465] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-07-15 21:11:02,424 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36465] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-15 21:11:02,425 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36465] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-15 21:11:02,447 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36465] procedure2.ProcedureExecutor(1029): Stored pid=17, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-15 21:11:02,449 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=17, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-15 21:11:02,450 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=17, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE; timeout=600000, timestamp=1689456062450 2023-07-15 21:11:02,450 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36465] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-15 21:11:02,450 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName 2023-07-15 21:11:02,454 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=17, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-15 21:11:02,456 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-15 21:11:02,457 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=17, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE in 14 msec 2023-07-15 21:11:02,458 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-15 21:11:02,458 DEBUG [Listener at jenkins-hbase4.apache.org/41711] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-15 21:11:02,458 DEBUG [Listener at jenkins-hbase4.apache.org/41711] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-15 21:11:02,459 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=18, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED; timeout=600000, timestamp=1689456062459 2023-07-15 21:11:02,558 DEBUG [Listener at jenkins-hbase4.apache.org/41711] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-15 21:11:02,561 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36465] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-15 21:11:02,563 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36465] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-15 21:11:02,563 DEBUG [Listener at jenkins-hbase4.apache.org/41711] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-15 21:11:02,763 DEBUG [Listener at jenkins-hbase4.apache.org/41711] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-15 21:11:02,765 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36465] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-15 21:11:02,765 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36465] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-15 21:11:02,765 DEBUG [Listener at jenkins-hbase4.apache.org/41711] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-15 21:11:02,894 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportWithTargetName 2023-07-15 21:11:02,894 INFO [(jenkins-hbase4.apache.org,36465,1689455450507)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportWithTargetName' 2023-07-15 21:11:02,894 DEBUG [(jenkins-hbase4.apache.org,36465,1689455450507)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 21:11:02,894 DEBUG [(jenkins-hbase4.apache.org,36465,1689455450507)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' 2023-07-15 21:11:02,894 DEBUG [(jenkins-hbase4.apache.org,36465,1689455450507)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportWithTargetName', kicking off acquire phase on members. 2023-07-15 21:11:02,895 DEBUG [(jenkins-hbase4.apache.org,36465,1689455450507)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36465-0x1016ad2d8bb0000, quorum=127.0.0.1:50024, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-15 21:11:02,895 DEBUG [(jenkins-hbase4.apache.org,36465,1689455450507)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-15 21:11:02,899 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): regionserver:39587-0x1016ad2d8bb0002, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 21:11:02,899 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): regionserver:39075-0x1016ad2d8bb0003, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 21:11:02,899 DEBUG [(jenkins-hbase4.apache.org,36465,1689455450507)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39587,1689455451998 2023-07-15 21:11:02,899 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): regionserver:37853-0x1016ad2d8bb0001, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 21:11:02,899 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 21:11:02,899 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 21:11:02,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 21:11:02,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 21:11:02,899 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 21:11:02,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 21:11:02,899 DEBUG [(jenkins-hbase4.apache.org,36465,1689455450507)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36465-0x1016ad2d8bb0000, quorum=127.0.0.1:50024, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39587,1689455451998 2023-07-15 21:11:02,899 DEBUG [(jenkins-hbase4.apache.org,36465,1689455450507)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39075,1689455452043 2023-07-15 21:11:02,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-15 21:11:02,900 DEBUG [(jenkins-hbase4.apache.org,36465,1689455450507)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36465-0x1016ad2d8bb0000, quorum=127.0.0.1:50024, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39075,1689455452043 2023-07-15 21:11:02,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-15 21:11:02,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-15 21:11:02,900 DEBUG [(jenkins-hbase4.apache.org,36465,1689455450507)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-15 21:11:02,900 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39587-0x1016ad2d8bb0002, quorum=127.0.0.1:50024, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-15 21:11:02,900 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39075-0x1016ad2d8bb0003, quorum=127.0.0.1:50024, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-15 21:11:02,900 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37853-0x1016ad2d8bb0001, quorum=127.0.0.1:50024, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-15 21:11:02,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-07-15 21:11:02,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-07-15 21:11:02,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-07-15 21:11:02,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-15 21:11:02,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-15 21:11:02,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-15 21:11:02,903 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-15 21:11:02,903 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-15 21:11:02,903 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-15 21:11:02,905 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-07-15 21:11:02,905 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-07-15 21:11:02,905 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-07-15 21:11:02,908 DEBUG [member: 'jenkins-hbase4.apache.org,39587,1689455451998' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-15 21:11:02,908 DEBUG [member: 'jenkins-hbase4.apache.org,37853,1689455451932' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-15 21:11:02,908 DEBUG [member: 'jenkins-hbase4.apache.org,39075,1689455452043' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-15 21:11:02,908 DEBUG [member: 'jenkins-hbase4.apache.org,39075,1689455452043' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 21:11:02,908 DEBUG [member: 'jenkins-hbase4.apache.org,39587,1689455451998' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 21:11:02,909 DEBUG [member: 'jenkins-hbase4.apache.org,39075,1689455452043' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-15 21:11:02,910 DEBUG [member: 'jenkins-hbase4.apache.org,39587,1689455451998' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-15 21:11:02,908 DEBUG [member: 'jenkins-hbase4.apache.org,37853,1689455451932' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 21:11:02,910 DEBUG [member: 'jenkins-hbase4.apache.org,39587,1689455451998' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-07-15 21:11:02,911 DEBUG [member: 'jenkins-hbase4.apache.org,37853,1689455451932' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-15 21:11:02,911 DEBUG [member: 'jenkins-hbase4.apache.org,37853,1689455451932' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-07-15 21:11:02,910 DEBUG [member: 'jenkins-hbase4.apache.org,39075,1689455452043' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-07-15 21:11:02,911 DEBUG [member: 'jenkins-hbase4.apache.org,37853,1689455451932' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37853,1689455451932' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-07-15 21:11:02,911 DEBUG [member: 'jenkins-hbase4.apache.org,39587,1689455451998' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39587,1689455451998' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-07-15 21:11:02,911 DEBUG [member: 'jenkins-hbase4.apache.org,39075,1689455452043' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39075,1689455452043' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-07-15 21:11:02,913 DEBUG [member: 'jenkins-hbase4.apache.org,37853,1689455451932' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-15 21:11:02,913 DEBUG [member: 'jenkins-hbase4.apache.org,39587,1689455451998' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-15 21:11:02,913 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): master:36465-0x1016ad2d8bb0000, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39587,1689455451998 2023-07-15 21:11:02,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39587,1689455451998 2023-07-15 21:11:02,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 21:11:02,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 21:11:02,914 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): master:36465-0x1016ad2d8bb0000, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39075,1689455452043 2023-07-15 21:11:02,914 DEBUG [member: 'jenkins-hbase4.apache.org,39075,1689455452043' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-15 21:11:02,914 DEBUG [member: 'jenkins-hbase4.apache.org,39587,1689455451998' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39587-0x1016ad2d8bb0002, quorum=127.0.0.1:50024, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-15 21:11:02,914 DEBUG [member: 'jenkins-hbase4.apache.org,37853,1689455451932' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37853-0x1016ad2d8bb0001, quorum=127.0.0.1:50024, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-15 21:11:02,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 21:11:02,914 DEBUG [member: 'jenkins-hbase4.apache.org,39587,1689455451998' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-15 21:11:02,914 DEBUG [member: 'jenkins-hbase4.apache.org,37853,1689455451932' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-15 21:11:02,915 DEBUG [member: 'jenkins-hbase4.apache.org,39075,1689455452043' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39075-0x1016ad2d8bb0003, quorum=127.0.0.1:50024, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-15 21:11:02,915 DEBUG [member: 'jenkins-hbase4.apache.org,39075,1689455452043' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-15 21:11:02,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 21:11:02,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-15 21:11:02,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39075,1689455452043 2023-07-15 21:11:02,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39587,1689455451998 2023-07-15 21:11:02,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37853,1689455451932 2023-07-15 21:11:02,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 21:11:02,917 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39587,1689455451998' joining acquired barrier for procedure 'emptySnaptb0-testExportWithTargetName' on coordinator 2023-07-15 21:11:02,917 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@741c5c21[Count = 1] remaining members to acquire global barrier 2023-07-15 21:11:02,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39075,1689455452043 2023-07-15 21:11:02,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 21:11:02,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 21:11:02,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 21:11:02,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 21:11:02,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-15 21:11:02,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39075,1689455452043 2023-07-15 21:11:02,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39587,1689455451998 2023-07-15 21:11:02,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37853,1689455451932 2023-07-15 21:11:02,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 21:11:02,920 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39075,1689455452043' joining acquired barrier for procedure 'emptySnaptb0-testExportWithTargetName' on coordinator 2023-07-15 21:11:02,920 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@741c5c21[Count = 0] remaining members to acquire global barrier 2023-07-15 21:11:02,920 DEBUG [(jenkins-hbase4.apache.org,36465,1689455450507)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportWithTargetName' starting 'in-barrier' execution. 2023-07-15 21:11:02,920 DEBUG [(jenkins-hbase4.apache.org,36465,1689455450507)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-15 21:11:02,923 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): regionserver:39075-0x1016ad2d8bb0003, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-15 21:11:02,923 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): regionserver:37853-0x1016ad2d8bb0001, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-15 21:11:02,923 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-15 21:11:02,923 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): regionserver:39587-0x1016ad2d8bb0002, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-15 21:11:02,924 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-15 21:11:02,924 DEBUG [(jenkins-hbase4.apache.org,36465,1689455450507)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36465-0x1016ad2d8bb0000, quorum=127.0.0.1:50024, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39587,1689455451998 2023-07-15 21:11:02,924 DEBUG [member: 'jenkins-hbase4.apache.org,39075,1689455452043' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-15 21:11:02,924 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-15 21:11:02,924 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-15 21:11:02,924 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-15 21:11:02,924 DEBUG [member: 'jenkins-hbase4.apache.org,37853,1689455451932' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-15 21:11:02,924 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-15 21:11:02,924 DEBUG [(jenkins-hbase4.apache.org,36465,1689455450507)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36465-0x1016ad2d8bb0000, quorum=127.0.0.1:50024, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39075,1689455452043 2023-07-15 21:11:02,924 DEBUG [member: 'jenkins-hbase4.apache.org,39587,1689455451998' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-15 21:11:02,924 DEBUG [(jenkins-hbase4.apache.org,36465,1689455450507)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-15 21:11:02,924 DEBUG [member: 'jenkins-hbase4.apache.org,37853,1689455451932' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-07-15 21:11:02,924 DEBUG [member: 'jenkins-hbase4.apache.org,37853,1689455451932' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,37853,1689455451932' in zk 2023-07-15 21:11:02,925 DEBUG [member: 'jenkins-hbase4.apache.org,39075,1689455452043' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-15 21:11:02,925 DEBUG [member: 'jenkins-hbase4.apache.org,39075,1689455452043' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-15 21:11:02,925 DEBUG [rs(jenkins-hbase4.apache.org,39075,1689455452043)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,,1689455461178.02d9b37da6522e108c062b61df6e3707. 2023-07-15 21:11:02,925 DEBUG [rs(jenkins-hbase4.apache.org,39587,1689455451998)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,1,1689455461178.7d9eedcece667f4c6074fc0931e96f3a. 2023-07-15 21:11:02,925 DEBUG [member: 'jenkins-hbase4.apache.org,39587,1689455451998' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-15 21:11:02,925 DEBUG [member: 'jenkins-hbase4.apache.org,39587,1689455451998' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-15 21:11:02,925 DEBUG [rs(jenkins-hbase4.apache.org,39587,1689455451998)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,1,1689455461178.7d9eedcece667f4c6074fc0931e96f3a. started... 2023-07-15 21:11:02,925 DEBUG [rs(jenkins-hbase4.apache.org,39075,1689455452043)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,,1689455461178.02d9b37da6522e108c062b61df6e3707. started... 2023-07-15 21:11:02,927 DEBUG [member: 'jenkins-hbase4.apache.org,37853,1689455451932' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-07-15 21:11:02,927 DEBUG [member: 'jenkins-hbase4.apache.org,37853,1689455451932' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 21:11:02,927 DEBUG [member: 'jenkins-hbase4.apache.org,37853,1689455451932' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-07-15 21:11:02,929 DEBUG [rs(jenkins-hbase4.apache.org,39587,1689455451998)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 7d9eedcece667f4c6074fc0931e96f3a: 2023-07-15 21:11:02,929 DEBUG [rs(jenkins-hbase4.apache.org,39075,1689455452043)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 02d9b37da6522e108c062b61df6e3707: 2023-07-15 21:11:02,930 DEBUG [rs(jenkins-hbase4.apache.org,39587,1689455451998)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,1,1689455461178.7d9eedcece667f4c6074fc0931e96f3a.' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-07-15 21:11:02,930 DEBUG [rs(jenkins-hbase4.apache.org,39075,1689455452043)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,,1689455461178.02d9b37da6522e108c062b61df6e3707.' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-07-15 21:11:02,935 DEBUG [rs(jenkins-hbase4.apache.org,39075,1689455452043)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-15 21:11:02,935 DEBUG [rs(jenkins-hbase4.apache.org,39587,1689455451998)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-15 21:11:02,940 DEBUG [rs(jenkins-hbase4.apache.org,39587,1689455451998)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-15 21:11:02,940 DEBUG [rs(jenkins-hbase4.apache.org,39075,1689455452043)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-15 21:11:02,970 DEBUG [rs(jenkins-hbase4.apache.org,39587,1689455451998)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,1,1689455461178.7d9eedcece667f4c6074fc0931e96f3a. completed. 2023-07-15 21:11:02,970 DEBUG [rs(jenkins-hbase4.apache.org,39587,1689455451998)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,1,1689455461178.7d9eedcece667f4c6074fc0931e96f3a. 2023-07-15 21:11:02,971 DEBUG [member: 'jenkins-hbase4.apache.org,39587,1689455451998' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-15 21:11:02,971 DEBUG [member: 'jenkins-hbase4.apache.org,39587,1689455451998' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-15 21:11:02,971 DEBUG [member: 'jenkins-hbase4.apache.org,39587,1689455451998' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,39587,1689455451998 2023-07-15 21:11:02,971 DEBUG [member: 'jenkins-hbase4.apache.org,39587,1689455451998' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-07-15 21:11:02,971 DEBUG [member: 'jenkins-hbase4.apache.org,39587,1689455451998' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,39587,1689455451998' in zk 2023-07-15 21:11:02,977 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): master:36465-0x1016ad2d8bb0000, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39587,1689455451998 2023-07-15 21:11:02,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39587,1689455451998 2023-07-15 21:11:02,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 21:11:02,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 21:11:02,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 21:11:02,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 21:11:02,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-15 21:11:02,980 DEBUG [rs(jenkins-hbase4.apache.org,39075,1689455452043)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,,1689455461178.02d9b37da6522e108c062b61df6e3707. completed. 2023-07-15 21:11:02,980 DEBUG [rs(jenkins-hbase4.apache.org,39075,1689455452043)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,,1689455461178.02d9b37da6522e108c062b61df6e3707. 2023-07-15 21:11:02,980 DEBUG [member: 'jenkins-hbase4.apache.org,39075,1689455452043' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-15 21:11:02,980 DEBUG [member: 'jenkins-hbase4.apache.org,39075,1689455452043' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-15 21:11:02,980 DEBUG [member: 'jenkins-hbase4.apache.org,39075,1689455452043' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,39075,1689455452043 2023-07-15 21:11:02,980 DEBUG [member: 'jenkins-hbase4.apache.org,39075,1689455452043' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-07-15 21:11:02,980 DEBUG [member: 'jenkins-hbase4.apache.org,39075,1689455452043' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,39075,1689455452043' in zk 2023-07-15 21:11:02,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39075,1689455452043 2023-07-15 21:11:02,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39587,1689455451998 2023-07-15 21:11:02,983 DEBUG [member: 'jenkins-hbase4.apache.org,39587,1689455451998' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-07-15 21:11:02,983 DEBUG [member: 'jenkins-hbase4.apache.org,39587,1689455451998' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 21:11:02,983 DEBUG [member: 'jenkins-hbase4.apache.org,39587,1689455451998' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-07-15 21:11:02,984 DEBUG [member: 'jenkins-hbase4.apache.org,39075,1689455452043' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-07-15 21:11:02,984 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): master:36465-0x1016ad2d8bb0000, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39075,1689455452043 2023-07-15 21:11:02,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37853,1689455451932 2023-07-15 21:11:02,984 DEBUG [member: 'jenkins-hbase4.apache.org,39075,1689455452043' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 21:11:02,984 DEBUG [member: 'jenkins-hbase4.apache.org,39075,1689455452043' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-07-15 21:11:02,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 21:11:02,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-15 21:11:02,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39075,1689455452043 2023-07-15 21:11:02,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39587,1689455451998 2023-07-15 21:11:02,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37853,1689455451932 2023-07-15 21:11:02,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,39587,1689455451998': 2023-07-15 21:11:02,991 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39587,1689455451998' released barrier for procedure'emptySnaptb0-testExportWithTargetName', counting down latch. Waiting for 1 more 2023-07-15 21:11:02,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39075,1689455452043 2023-07-15 21:11:02,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 21:11:02,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 21:11:02,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 21:11:02,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 21:11:02,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-15 21:11:02,993 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39075,1689455452043 2023-07-15 21:11:02,993 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39587,1689455451998 2023-07-15 21:11:02,993 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37853,1689455451932 2023-07-15 21:11:02,994 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 21:11:02,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-15 21:11:02,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39075,1689455452043 2023-07-15 21:11:02,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39587,1689455451998 2023-07-15 21:11:02,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37853,1689455451932 2023-07-15 21:11:02,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,39075,1689455452043': 2023-07-15 21:11:02,997 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39075,1689455452043' released barrier for procedure'emptySnaptb0-testExportWithTargetName', counting down latch. Waiting for 0 more 2023-07-15 21:11:02,997 INFO [(jenkins-hbase4.apache.org,36465,1689455450507)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportWithTargetName' execution completed 2023-07-15 21:11:02,997 DEBUG [(jenkins-hbase4.apache.org,36465,1689455450507)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-15 21:11:02,997 DEBUG [(jenkins-hbase4.apache.org,36465,1689455450507)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-15 21:11:02,997 DEBUG [(jenkins-hbase4.apache.org,36465,1689455450507)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportWithTargetName 2023-07-15 21:11:02,997 INFO [(jenkins-hbase4.apache.org,36465,1689455450507)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportWithTargetNameincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-15 21:11:03,001 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): regionserver:39075-0x1016ad2d8bb0003, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-15 21:11:03,001 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): regionserver:37853-0x1016ad2d8bb0001, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-15 21:11:03,001 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): regionserver:39587-0x1016ad2d8bb0002, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-15 21:11:03,001 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): master:36465-0x1016ad2d8bb0000, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-15 21:11:03,001 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-15 21:11:03,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-15 21:11:03,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 21:11:03,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 21:11:03,001 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-15 21:11:03,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-15 21:11:03,001 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): regionserver:39587-0x1016ad2d8bb0002, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 21:11:03,001 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-15 21:11:03,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-15 21:11:03,001 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): regionserver:37853-0x1016ad2d8bb0001, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 21:11:03,001 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): regionserver:39075-0x1016ad2d8bb0003, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 21:11:03,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-15 21:11:03,002 DEBUG [(jenkins-hbase4.apache.org,36465,1689455450507)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36465-0x1016ad2d8bb0000, quorum=127.0.0.1:50024, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39075,1689455452043 2023-07-15 21:11:03,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 21:11:03,002 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 21:11:03,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 21:11:03,003 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 21:11:03,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 21:11:03,003 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 21:11:03,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 21:11:03,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-15 21:11:03,003 DEBUG [(jenkins-hbase4.apache.org,36465,1689455450507)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36465-0x1016ad2d8bb0000, quorum=127.0.0.1:50024, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39587,1689455451998 2023-07-15 21:11:03,004 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-15 21:11:03,004 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-15 21:11:03,004 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-15 21:11:03,004 DEBUG [(jenkins-hbase4.apache.org,36465,1689455450507)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36465-0x1016ad2d8bb0000, quorum=127.0.0.1:50024, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,37853,1689455451932 2023-07-15 21:11:03,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 21:11:03,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-15 21:11:03,006 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39075,1689455452043 2023-07-15 21:11:03,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39587,1689455451998 2023-07-15 21:11:03,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37853,1689455451932 2023-07-15 21:11:03,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 21:11:03,010 DEBUG [(jenkins-hbase4.apache.org,36465,1689455450507)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36465-0x1016ad2d8bb0000, quorum=127.0.0.1:50024, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39075,1689455452043 2023-07-15 21:11:03,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-15 21:11:03,010 DEBUG [(jenkins-hbase4.apache.org,36465,1689455450507)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36465-0x1016ad2d8bb0000, quorum=127.0.0.1:50024, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39587,1689455451998 2023-07-15 21:11:03,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39075,1689455452043 2023-07-15 21:11:03,011 DEBUG [(jenkins-hbase4.apache.org,36465,1689455450507)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36465-0x1016ad2d8bb0000, quorum=127.0.0.1:50024, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,37853,1689455451932 2023-07-15 21:11:03,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39587,1689455451998 2023-07-15 21:11:03,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37853,1689455451932 2023-07-15 21:11:03,027 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): regionserver:39075-0x1016ad2d8bb0003, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 21:11:03,027 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): regionserver:39587-0x1016ad2d8bb0002, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 21:11:03,027 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 21:11:03,027 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 21:11:03,027 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): regionserver:39075-0x1016ad2d8bb0003, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 21:11:03,027 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): regionserver:37853-0x1016ad2d8bb0001, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 21:11:03,027 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): master:36465-0x1016ad2d8bb0000, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,37853,1689455451932 2023-07-15 21:11:03,027 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 21:11:03,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 21:11:03,027 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): master:36465-0x1016ad2d8bb0000, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-15 21:11:03,027 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): regionserver:37853-0x1016ad2d8bb0001, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 21:11:03,027 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): master:36465-0x1016ad2d8bb0000, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39587,1689455451998 2023-07-15 21:11:03,027 DEBUG [(jenkins-hbase4.apache.org,36465,1689455450507)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 21:11:03,027 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportWithTargetName 2023-07-15 21:11:03,028 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportWithTargetName 2023-07-15 21:11:03,029 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 21:11:03,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 21:11:03,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 21:11:03,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 21:11:03,027 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): regionserver:39587-0x1016ad2d8bb0002, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 21:11:03,029 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 90c8eeaaf01a24f585da11044309be71, NAME => 'testtb-testExportWithTargetName,.mob,0.90c8eeaaf01a24f585da11044309be71.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-07-15 21:11:03,030 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-15 21:11:03,027 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): master:36465-0x1016ad2d8bb0000, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39075,1689455452043 2023-07-15 21:11:03,030 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): master:36465-0x1016ad2d8bb0000, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-15 21:11:03,030 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): master:36465-0x1016ad2d8bb0000, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,37853,1689455451932 2023-07-15 21:11:03,031 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): master:36465-0x1016ad2d8bb0000, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-15 21:11:03,031 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): master:36465-0x1016ad2d8bb0000, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39587,1689455451998 2023-07-15 21:11:03,031 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): master:36465-0x1016ad2d8bb0000, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39075,1689455452043 2023-07-15 21:11:03,031 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): master:36465-0x1016ad2d8bb0000, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-15 21:11:03,031 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): master:36465-0x1016ad2d8bb0000, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-15 21:11:03,031 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 21:11:03,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 21:11:03,031 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 21:11:03,031 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-07-15 21:11:03,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 21:11:03,050 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportWithTargetName 2023-07-15 21:11:03,053 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-07-15 21:11:03,066 DEBUG [Listener at jenkins-hbase4.apache.org/41711] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-15 21:11:03,067 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36465] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-15 21:11:03,067 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36465] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-15 21:11:03,067 DEBUG [Listener at jenkins-hbase4.apache.org/41711] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-07-15 21:11:03,118 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName to hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/.hbase-snapshot/emptySnaptb0-testExportWithTargetName 2023-07-15 21:11:03,166 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed 2023-07-15 21:11:03,166 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-07-15 21:11:03,167 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-07-15 21:11:03,167 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName at 1689455462451Completed referencing HFiles for the mob region of table: testtb-testExportWithTargetName at 1689455463050 (+599 ms)Consolidate snapshot: emptySnaptb0-testExportWithTargetName at 1689455463050Loading Region manifests for emptySnaptb0-testExportWithTargetName at 1689455463050Writing data manifest for emptySnaptb0-testExportWithTargetName at 1689455463068 (+18 ms)Verifying snapshot: emptySnaptb0-testExportWithTargetName at 1689455463102 (+34 ms)Snapshot emptySnaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed at 1689455463166 (+64 ms) 2023-07-15 21:11:03,169 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=18, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-15 21:11:03,171 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=18, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED in 714 msec 2023-07-15 21:11:03,568 DEBUG [Listener at jenkins-hbase4.apache.org/41711] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-15 21:11:03,571 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36465] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-15 21:11:03,571 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36465] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-15 21:11:03,587 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39075] regionserver.HRegion(8805): writing data to region testtb-testExportWithTargetName,,1689455461178.02d9b37da6522e108c062b61df6e3707. with WAL disabled. Data may be lost in the event of a crash. 2023-07-15 21:11:03,590 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39587] regionserver.HRegion(8805): writing data to region testtb-testExportWithTargetName,1,1689455461178.7d9eedcece667f4c6074fc0931e96f3a. with WAL disabled. Data may be lost in the event of a crash. 2023-07-15 21:11:03,596 DEBUG [Listener at jenkins-hbase4.apache.org/41711] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportWithTargetName 2023-07-15 21:11:03,596 DEBUG [Listener at jenkins-hbase4.apache.org/41711] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportWithTargetName,,1689455461178.02d9b37da6522e108c062b61df6e3707. 2023-07-15 21:11:03,596 INFO [Listener at jenkins-hbase4.apache.org/41711] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-15 21:11:03,619 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36465] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-15 21:11:03,619 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36465] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689455463619 (current time:1689455463619). 2023-07-15 21:11:03,619 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36465] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-15 21:11:03,620 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36465] zookeeper.ReadOnlyZKClient(139): Connect 0x317b8cd6 to 127.0.0.1:50024 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-15 21:11:03,627 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36465] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7beab3ef, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-15 21:11:03,629 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36465] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-15 21:11:03,632 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:50970, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-15 21:11:03,633 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36465] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x317b8cd6 to 127.0.0.1:50024 2023-07-15 21:11:03,634 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36465] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-15 21:11:03,634 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36465] zookeeper.ReadOnlyZKClient(139): Connect 0x58dbe3b0 to 127.0.0.1:50024 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-15 21:11:03,640 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36465] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@352bd941, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-15 21:11:03,642 DEBUG [hconnection-0x1b7061c0-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-15 21:11:03,643 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:50986, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-15 21:11:03,648 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36465] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x58dbe3b0 to 127.0.0.1:50024 2023-07-15 21:11:03,648 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36465] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-15 21:11:03,649 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36465] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-07-15 21:11:03,650 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36465] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-15 21:11:03,650 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36465] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-15 21:11:03,653 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36465] procedure2.ProcedureExecutor(1029): Stored pid=19, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-15 21:11:03,654 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=19, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-15 21:11:03,655 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=19, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE; timeout=600000, timestamp=1689456063655 2023-07-15 21:11:03,655 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36465] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-15 21:11:03,655 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName 2023-07-15 21:11:03,657 DEBUG [Listener at jenkins-hbase4.apache.org/41711] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-15 21:11:03,657 DEBUG [Listener at jenkins-hbase4.apache.org/41711] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-15 21:11:03,657 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=20, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-15 21:11:03,658 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=19, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-15 21:11:03,659 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=19, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE in 7 msec 2023-07-15 21:11:03,660 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=20, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-15 21:11:03,661 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=20, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED; timeout=600000, timestamp=1689456063661 2023-07-15 21:11:03,679 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportWithTargetName 2023-07-15 21:11:03,679 INFO [(jenkins-hbase4.apache.org,36465,1689455450507)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportWithTargetName' 2023-07-15 21:11:03,679 DEBUG [(jenkins-hbase4.apache.org,36465,1689455450507)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 21:11:03,681 DEBUG [(jenkins-hbase4.apache.org,36465,1689455450507)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportWithTargetName' starting 'acquire' 2023-07-15 21:11:03,681 DEBUG [(jenkins-hbase4.apache.org,36465,1689455450507)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportWithTargetName', kicking off acquire phase on members. 2023-07-15 21:11:03,681 DEBUG [(jenkins-hbase4.apache.org,36465,1689455450507)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36465-0x1016ad2d8bb0000, quorum=127.0.0.1:50024, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-15 21:11:03,681 DEBUG [(jenkins-hbase4.apache.org,36465,1689455450507)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-15 21:11:03,683 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): regionserver:39075-0x1016ad2d8bb0003, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 21:11:03,683 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): regionserver:37853-0x1016ad2d8bb0001, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 21:11:03,683 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 21:11:03,683 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 21:11:03,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 21:11:03,683 DEBUG [(jenkins-hbase4.apache.org,36465,1689455450507)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39587,1689455451998 2023-07-15 21:11:03,683 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): regionserver:39587-0x1016ad2d8bb0002, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 21:11:03,683 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 21:11:03,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 21:11:03,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 21:11:03,684 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-15 21:11:03,684 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-15 21:11:03,684 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-15 21:11:03,684 DEBUG [(jenkins-hbase4.apache.org,36465,1689455450507)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36465-0x1016ad2d8bb0000, quorum=127.0.0.1:50024, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39587,1689455451998 2023-07-15 21:11:03,684 DEBUG [(jenkins-hbase4.apache.org,36465,1689455450507)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39075,1689455452043 2023-07-15 21:11:03,684 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37853-0x1016ad2d8bb0001, quorum=127.0.0.1:50024, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-15 21:11:03,684 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39587-0x1016ad2d8bb0002, quorum=127.0.0.1:50024, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-15 21:11:03,685 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39075-0x1016ad2d8bb0003, quorum=127.0.0.1:50024, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-15 21:11:03,685 DEBUG [(jenkins-hbase4.apache.org,36465,1689455450507)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36465-0x1016ad2d8bb0000, quorum=127.0.0.1:50024, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39075,1689455452043 2023-07-15 21:11:03,685 DEBUG [(jenkins-hbase4.apache.org,36465,1689455450507)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-15 21:11:03,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-07-15 21:11:03,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-15 21:11:03,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-07-15 21:11:03,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-07-15 21:11:03,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-15 21:11:03,685 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-15 21:11:03,685 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-15 21:11:03,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-15 21:11:03,685 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-07-15 21:11:03,685 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-15 21:11:03,686 DEBUG [member: 'jenkins-hbase4.apache.org,37853,1689455451932' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-15 21:11:03,686 DEBUG [member: 'jenkins-hbase4.apache.org,37853,1689455451932' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 21:11:03,685 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-07-15 21:11:03,687 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-07-15 21:11:03,687 DEBUG [member: 'jenkins-hbase4.apache.org,39075,1689455452043' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-15 21:11:03,687 DEBUG [member: 'jenkins-hbase4.apache.org,39587,1689455451998' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-15 21:11:03,687 DEBUG [member: 'jenkins-hbase4.apache.org,39587,1689455451998' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 21:11:03,687 DEBUG [member: 'jenkins-hbase4.apache.org,37853,1689455451932' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-15 21:11:03,688 DEBUG [member: 'jenkins-hbase4.apache.org,39587,1689455451998' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-15 21:11:03,688 DEBUG [member: 'jenkins-hbase4.apache.org,39587,1689455451998' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-07-15 21:11:03,688 DEBUG [member: 'jenkins-hbase4.apache.org,39587,1689455451998' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39587,1689455451998' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-07-15 21:11:03,688 DEBUG [member: 'jenkins-hbase4.apache.org,37853,1689455451932' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-07-15 21:11:03,687 DEBUG [member: 'jenkins-hbase4.apache.org,39075,1689455452043' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 21:11:03,688 DEBUG [member: 'jenkins-hbase4.apache.org,37853,1689455451932' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37853,1689455451932' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-07-15 21:11:03,689 DEBUG [member: 'jenkins-hbase4.apache.org,39075,1689455452043' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-15 21:11:03,689 DEBUG [member: 'jenkins-hbase4.apache.org,39075,1689455452043' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-07-15 21:11:03,689 DEBUG [member: 'jenkins-hbase4.apache.org,39075,1689455452043' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39075,1689455452043' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-07-15 21:11:03,692 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): master:36465-0x1016ad2d8bb0000, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39587,1689455451998 2023-07-15 21:11:03,692 DEBUG [member: 'jenkins-hbase4.apache.org,39587,1689455451998' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-15 21:11:03,692 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39587,1689455451998 2023-07-15 21:11:03,692 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 21:11:03,692 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 21:11:03,692 DEBUG [member: 'jenkins-hbase4.apache.org,37853,1689455451932' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-15 21:11:03,694 DEBUG [member: 'jenkins-hbase4.apache.org,39075,1689455452043' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-15 21:11:03,694 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): master:36465-0x1016ad2d8bb0000, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39075,1689455452043 2023-07-15 21:11:03,694 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 21:11:03,694 DEBUG [member: 'jenkins-hbase4.apache.org,39587,1689455451998' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39587-0x1016ad2d8bb0002, quorum=127.0.0.1:50024, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-15 21:11:03,694 DEBUG [member: 'jenkins-hbase4.apache.org,39587,1689455451998' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-15 21:11:03,694 DEBUG [member: 'jenkins-hbase4.apache.org,37853,1689455451932' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37853-0x1016ad2d8bb0001, quorum=127.0.0.1:50024, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-15 21:11:03,694 DEBUG [member: 'jenkins-hbase4.apache.org,37853,1689455451932' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-15 21:11:03,694 DEBUG [member: 'jenkins-hbase4.apache.org,39075,1689455452043' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39075-0x1016ad2d8bb0003, quorum=127.0.0.1:50024, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-15 21:11:03,694 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 21:11:03,694 DEBUG [member: 'jenkins-hbase4.apache.org,39075,1689455452043' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-15 21:11:03,694 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-15 21:11:03,695 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39075,1689455452043 2023-07-15 21:11:03,695 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39587,1689455451998 2023-07-15 21:11:03,695 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37853,1689455451932 2023-07-15 21:11:03,696 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 21:11:03,696 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39587,1689455451998' joining acquired barrier for procedure 'snaptb0-testExportWithTargetName' on coordinator 2023-07-15 21:11:03,696 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1ff4143e[Count = 1] remaining members to acquire global barrier 2023-07-15 21:11:03,696 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39075,1689455452043 2023-07-15 21:11:03,696 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 21:11:03,696 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 21:11:03,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 21:11:03,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 21:11:03,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-15 21:11:03,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39075,1689455452043 2023-07-15 21:11:03,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39587,1689455451998 2023-07-15 21:11:03,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37853,1689455451932 2023-07-15 21:11:03,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 21:11:03,699 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39075,1689455452043' joining acquired barrier for procedure 'snaptb0-testExportWithTargetName' on coordinator 2023-07-15 21:11:03,699 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1ff4143e[Count = 0] remaining members to acquire global barrier 2023-07-15 21:11:03,699 DEBUG [(jenkins-hbase4.apache.org,36465,1689455450507)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportWithTargetName' starting 'in-barrier' execution. 2023-07-15 21:11:03,699 DEBUG [(jenkins-hbase4.apache.org,36465,1689455450507)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-15 21:11:03,703 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): regionserver:39587-0x1016ad2d8bb0002, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-15 21:11:03,703 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): regionserver:39075-0x1016ad2d8bb0003, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-15 21:11:03,703 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-15 21:11:03,703 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-15 21:11:03,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-15 21:11:03,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-15 21:11:03,703 DEBUG [(jenkins-hbase4.apache.org,36465,1689455450507)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36465-0x1016ad2d8bb0000, quorum=127.0.0.1:50024, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39587,1689455451998 2023-07-15 21:11:03,703 DEBUG [member: 'jenkins-hbase4.apache.org,39075,1689455452043' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-15 21:11:03,703 DEBUG [member: 'jenkins-hbase4.apache.org,39587,1689455451998' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-15 21:11:03,703 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): regionserver:37853-0x1016ad2d8bb0001, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-15 21:11:03,703 DEBUG [member: 'jenkins-hbase4.apache.org,39075,1689455452043' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-15 21:11:03,703 DEBUG [(jenkins-hbase4.apache.org,36465,1689455450507)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36465-0x1016ad2d8bb0000, quorum=127.0.0.1:50024, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39075,1689455452043 2023-07-15 21:11:03,703 DEBUG [rs(jenkins-hbase4.apache.org,39075,1689455452043)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,,1689455461178.02d9b37da6522e108c062b61df6e3707. 2023-07-15 21:11:03,703 DEBUG [member: 'jenkins-hbase4.apache.org,39587,1689455451998' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-15 21:11:03,704 DEBUG [rs(jenkins-hbase4.apache.org,39587,1689455451998)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,1,1689455461178.7d9eedcece667f4c6074fc0931e96f3a. 2023-07-15 21:11:03,703 DEBUG [member: 'jenkins-hbase4.apache.org,39075,1689455452043' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-15 21:11:03,704 DEBUG [rs(jenkins-hbase4.apache.org,39587,1689455451998)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,1,1689455461178.7d9eedcece667f4c6074fc0931e96f3a. started... 2023-07-15 21:11:03,704 DEBUG [member: 'jenkins-hbase4.apache.org,39587,1689455451998' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-15 21:11:03,704 DEBUG [rs(jenkins-hbase4.apache.org,39075,1689455452043)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,,1689455461178.02d9b37da6522e108c062b61df6e3707. started... 2023-07-15 21:11:03,703 DEBUG [(jenkins-hbase4.apache.org,36465,1689455450507)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-15 21:11:03,704 INFO [rs(jenkins-hbase4.apache.org,39075,1689455452043)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 02d9b37da6522e108c062b61df6e3707 1/1 column families, dataSize=333 B heapSize=976 B 2023-07-15 21:11:03,704 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-15 21:11:03,704 INFO [rs(jenkins-hbase4.apache.org,39587,1689455451998)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 7d9eedcece667f4c6074fc0931e96f3a 1/1 column families, dataSize=2.93 KB heapSize=6.58 KB 2023-07-15 21:11:03,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-15 21:11:03,704 DEBUG [member: 'jenkins-hbase4.apache.org,37853,1689455451932' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-15 21:11:03,704 DEBUG [member: 'jenkins-hbase4.apache.org,37853,1689455451932' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-07-15 21:11:03,704 DEBUG [member: 'jenkins-hbase4.apache.org,37853,1689455451932' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,37853,1689455451932' in zk 2023-07-15 21:11:03,708 DEBUG [member: 'jenkins-hbase4.apache.org,37853,1689455451932' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-07-15 21:11:03,708 DEBUG [member: 'jenkins-hbase4.apache.org,37853,1689455451932' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 21:11:03,708 DEBUG [member: 'jenkins-hbase4.apache.org,37853,1689455451932' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-07-15 21:11:03,757 DEBUG [Listener at jenkins-hbase4.apache.org/41711] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-15 21:11:03,759 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36465] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-15 21:11:03,759 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36465] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-15 21:11:03,759 DEBUG [Listener at jenkins-hbase4.apache.org/41711] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-15 21:11:03,869 INFO [rs(jenkins-hbase4.apache.org,39587,1689455451998)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230715f4db63a1eab64ba092bd63d649e778cc to hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b20230715f4db63a1eab64ba092bd63d649e778cc 2023-07-15 21:11:03,900 INFO [rs(jenkins-hbase4.apache.org,39587,1689455451998)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=2.9 K, hasBloomFilter=true, into tmp file hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/data/default/testtb-testExportWithTargetName/7d9eedcece667f4c6074fc0931e96f3a/.tmp/cf/607ccb375ce14e22a829aafc1c5f4104 2023-07-15 21:11:03,911 DEBUG [rs(jenkins-hbase4.apache.org,39587,1689455451998)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/data/default/testtb-testExportWithTargetName/7d9eedcece667f4c6074fc0931e96f3a/.tmp/cf/607ccb375ce14e22a829aafc1c5f4104 as hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/data/default/testtb-testExportWithTargetName/7d9eedcece667f4c6074fc0931e96f3a/cf/607ccb375ce14e22a829aafc1c5f4104 2023-07-15 21:11:03,922 INFO [rs(jenkins-hbase4.apache.org,39587,1689455451998)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/data/default/testtb-testExportWithTargetName/7d9eedcece667f4c6074fc0931e96f3a/cf/607ccb375ce14e22a829aafc1c5f4104, entries=45, sequenceid=6, filesize=12.5 K 2023-07-15 21:11:03,925 INFO [rs(jenkins-hbase4.apache.org,39587,1689455451998)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~2.93 KB/3003, heapSize ~6.56 KB/6720, currentSize=0 B/0 for 7d9eedcece667f4c6074fc0931e96f3a in 220ms, sequenceid=6, compaction requested=false 2023-07-15 21:11:03,925 DEBUG [rs(jenkins-hbase4.apache.org,39587,1689455451998)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportWithTargetName' 2023-07-15 21:11:03,925 DEBUG [rs(jenkins-hbase4.apache.org,39587,1689455451998)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 7d9eedcece667f4c6074fc0931e96f3a: 2023-07-15 21:11:03,926 DEBUG [rs(jenkins-hbase4.apache.org,39587,1689455451998)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,1,1689455461178.7d9eedcece667f4c6074fc0931e96f3a.' region-info for snapshot=snaptb0-testExportWithTargetName 2023-07-15 21:11:03,926 DEBUG [rs(jenkins-hbase4.apache.org,39587,1689455451998)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-15 21:11:03,926 DEBUG [rs(jenkins-hbase4.apache.org,39587,1689455451998)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/data/default/testtb-testExportWithTargetName/7d9eedcece667f4c6074fc0931e96f3a/cf/607ccb375ce14e22a829aafc1c5f4104] hfiles 2023-07-15 21:11:03,926 DEBUG [rs(jenkins-hbase4.apache.org,39587,1689455451998)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/data/default/testtb-testExportWithTargetName/7d9eedcece667f4c6074fc0931e96f3a/cf/607ccb375ce14e22a829aafc1c5f4104 for snapshot=snaptb0-testExportWithTargetName 2023-07-15 21:11:03,948 DEBUG [rs(jenkins-hbase4.apache.org,39587,1689455451998)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,1,1689455461178.7d9eedcece667f4c6074fc0931e96f3a. completed. 2023-07-15 21:11:03,948 DEBUG [rs(jenkins-hbase4.apache.org,39587,1689455451998)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,1,1689455461178.7d9eedcece667f4c6074fc0931e96f3a. 2023-07-15 21:11:03,948 DEBUG [member: 'jenkins-hbase4.apache.org,39587,1689455451998' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-15 21:11:03,949 DEBUG [member: 'jenkins-hbase4.apache.org,39587,1689455451998' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-15 21:11:03,949 DEBUG [member: 'jenkins-hbase4.apache.org,39587,1689455451998' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,39587,1689455451998 2023-07-15 21:11:03,949 DEBUG [member: 'jenkins-hbase4.apache.org,39587,1689455451998' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-07-15 21:11:03,949 DEBUG [member: 'jenkins-hbase4.apache.org,39587,1689455451998' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,39587,1689455451998' in zk 2023-07-15 21:11:03,952 DEBUG [member: 'jenkins-hbase4.apache.org,39587,1689455451998' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-07-15 21:11:03,952 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): master:36465-0x1016ad2d8bb0000, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39587,1689455451998 2023-07-15 21:11:03,952 DEBUG [member: 'jenkins-hbase4.apache.org,39587,1689455451998' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 21:11:03,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39587,1689455451998 2023-07-15 21:11:03,952 DEBUG [member: 'jenkins-hbase4.apache.org,39587,1689455451998' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-07-15 21:11:03,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 21:11:03,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 21:11:03,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 21:11:03,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 21:11:03,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-15 21:11:03,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39075,1689455452043 2023-07-15 21:11:03,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39587,1689455451998 2023-07-15 21:11:03,959 DEBUG [Listener at jenkins-hbase4.apache.org/41711] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-15 21:11:03,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37853,1689455451932 2023-07-15 21:11:03,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 21:11:03,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-15 21:11:03,961 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36465] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-15 21:11:03,961 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36465] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-15 21:11:03,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39587,1689455451998 2023-07-15 21:11:03,961 DEBUG [Listener at jenkins-hbase4.apache.org/41711] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-15 21:11:03,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37853,1689455451932 2023-07-15 21:11:03,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,39587,1689455451998': 2023-07-15 21:11:03,963 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39587,1689455451998' released barrier for procedure'snaptb0-testExportWithTargetName', counting down latch. Waiting for 1 more 2023-07-15 21:11:04,221 INFO [rs(jenkins-hbase4.apache.org,39075,1689455452043)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230715e5d26f18d8fa4e58a1ffe6ae9a889aaf to hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e20230715e5d26f18d8fa4e58a1ffe6ae9a889aaf 2023-07-15 21:11:04,242 INFO [rs(jenkins-hbase4.apache.org,39075,1689455452043)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=333, hasBloomFilter=true, into tmp file hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/data/default/testtb-testExportWithTargetName/02d9b37da6522e108c062b61df6e3707/.tmp/cf/ea3656847b1d400186924df2a91c0103 2023-07-15 21:11:04,252 DEBUG [rs(jenkins-hbase4.apache.org,39075,1689455452043)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/data/default/testtb-testExportWithTargetName/02d9b37da6522e108c062b61df6e3707/.tmp/cf/ea3656847b1d400186924df2a91c0103 as hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/data/default/testtb-testExportWithTargetName/02d9b37da6522e108c062b61df6e3707/cf/ea3656847b1d400186924df2a91c0103 2023-07-15 21:11:04,260 INFO [rs(jenkins-hbase4.apache.org,39075,1689455452043)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/data/default/testtb-testExportWithTargetName/02d9b37da6522e108c062b61df6e3707/cf/ea3656847b1d400186924df2a91c0103, entries=5, sequenceid=6, filesize=5.7 K 2023-07-15 21:11:04,262 DEBUG [Listener at jenkins-hbase4.apache.org/41711] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-15 21:11:04,264 INFO [rs(jenkins-hbase4.apache.org,39075,1689455452043)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~333 B/333, heapSize ~960 B/960, currentSize=0 B/0 for 02d9b37da6522e108c062b61df6e3707 in 560ms, sequenceid=6, compaction requested=false 2023-07-15 21:11:04,265 DEBUG [rs(jenkins-hbase4.apache.org,39075,1689455452043)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 02d9b37da6522e108c062b61df6e3707: 2023-07-15 21:11:04,265 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36465] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-15 21:11:04,265 DEBUG [rs(jenkins-hbase4.apache.org,39075,1689455452043)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,,1689455461178.02d9b37da6522e108c062b61df6e3707.' region-info for snapshot=snaptb0-testExportWithTargetName 2023-07-15 21:11:04,265 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36465] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-15 21:11:04,265 DEBUG [rs(jenkins-hbase4.apache.org,39075,1689455452043)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-15 21:11:04,265 DEBUG [rs(jenkins-hbase4.apache.org,39075,1689455452043)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/data/default/testtb-testExportWithTargetName/02d9b37da6522e108c062b61df6e3707/cf/ea3656847b1d400186924df2a91c0103] hfiles 2023-07-15 21:11:04,265 DEBUG [rs(jenkins-hbase4.apache.org,39075,1689455452043)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/data/default/testtb-testExportWithTargetName/02d9b37da6522e108c062b61df6e3707/cf/ea3656847b1d400186924df2a91c0103 for snapshot=snaptb0-testExportWithTargetName 2023-07-15 21:11:04,266 DEBUG [Listener at jenkins-hbase4.apache.org/41711] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-07-15 21:11:04,289 DEBUG [rs(jenkins-hbase4.apache.org,39075,1689455452043)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,,1689455461178.02d9b37da6522e108c062b61df6e3707. completed. 2023-07-15 21:11:04,289 DEBUG [rs(jenkins-hbase4.apache.org,39075,1689455452043)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,,1689455461178.02d9b37da6522e108c062b61df6e3707. 2023-07-15 21:11:04,289 DEBUG [member: 'jenkins-hbase4.apache.org,39075,1689455452043' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-15 21:11:04,289 DEBUG [member: 'jenkins-hbase4.apache.org,39075,1689455452043' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-15 21:11:04,289 DEBUG [member: 'jenkins-hbase4.apache.org,39075,1689455452043' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,39075,1689455452043 2023-07-15 21:11:04,289 DEBUG [member: 'jenkins-hbase4.apache.org,39075,1689455452043' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-07-15 21:11:04,289 DEBUG [member: 'jenkins-hbase4.apache.org,39075,1689455452043' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,39075,1689455452043' in zk 2023-07-15 21:11:04,293 DEBUG [member: 'jenkins-hbase4.apache.org,39075,1689455452043' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-07-15 21:11:04,293 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): master:36465-0x1016ad2d8bb0000, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39075,1689455452043 2023-07-15 21:11:04,293 DEBUG [member: 'jenkins-hbase4.apache.org,39075,1689455452043' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 21:11:04,293 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39075,1689455452043 2023-07-15 21:11:04,293 DEBUG [member: 'jenkins-hbase4.apache.org,39075,1689455452043' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-07-15 21:11:04,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 21:11:04,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 21:11:04,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 21:11:04,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 21:11:04,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-15 21:11:04,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39075,1689455452043 2023-07-15 21:11:04,296 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39587,1689455451998 2023-07-15 21:11:04,296 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37853,1689455451932 2023-07-15 21:11:04,296 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 21:11:04,297 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-15 21:11:04,297 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39075,1689455452043 2023-07-15 21:11:04,297 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39587,1689455451998 2023-07-15 21:11:04,298 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37853,1689455451932 2023-07-15 21:11:04,298 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,39075,1689455452043': 2023-07-15 21:11:04,299 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39075,1689455452043' released barrier for procedure'snaptb0-testExportWithTargetName', counting down latch. Waiting for 0 more 2023-07-15 21:11:04,299 INFO [(jenkins-hbase4.apache.org,36465,1689455450507)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportWithTargetName' execution completed 2023-07-15 21:11:04,299 DEBUG [(jenkins-hbase4.apache.org,36465,1689455450507)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-15 21:11:04,299 DEBUG [(jenkins-hbase4.apache.org,36465,1689455450507)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-15 21:11:04,299 DEBUG [(jenkins-hbase4.apache.org,36465,1689455450507)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportWithTargetName 2023-07-15 21:11:04,299 INFO [(jenkins-hbase4.apache.org,36465,1689455450507)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportWithTargetNameincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-15 21:11:04,301 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): regionserver:39075-0x1016ad2d8bb0003, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-15 21:11:04,301 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): regionserver:37853-0x1016ad2d8bb0001, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-15 21:11:04,301 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): master:36465-0x1016ad2d8bb0000, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-15 21:11:04,301 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-15 21:11:04,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-15 21:11:04,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 21:11:04,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 21:11:04,301 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): regionserver:37853-0x1016ad2d8bb0001, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 21:11:04,301 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-15 21:11:04,301 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): regionserver:39587-0x1016ad2d8bb0002, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-15 21:11:04,301 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): regionserver:39075-0x1016ad2d8bb0003, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 21:11:04,301 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-15 21:11:04,301 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): regionserver:39587-0x1016ad2d8bb0002, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 21:11:04,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-15 21:11:04,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-15 21:11:04,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 21:11:04,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-15 21:11:04,302 DEBUG [(jenkins-hbase4.apache.org,36465,1689455450507)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36465-0x1016ad2d8bb0000, quorum=127.0.0.1:50024, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39075,1689455452043 2023-07-15 21:11:04,302 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 21:11:04,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 21:11:04,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-15 21:11:04,302 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 21:11:04,302 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 21:11:04,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 21:11:04,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-15 21:11:04,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 21:11:04,303 DEBUG [(jenkins-hbase4.apache.org,36465,1689455450507)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36465-0x1016ad2d8bb0000, quorum=127.0.0.1:50024, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39587,1689455451998 2023-07-15 21:11:04,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-15 21:11:04,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 21:11:04,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-15 21:11:04,304 DEBUG [(jenkins-hbase4.apache.org,36465,1689455450507)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36465-0x1016ad2d8bb0000, quorum=127.0.0.1:50024, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,37853,1689455451932 2023-07-15 21:11:04,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-15 21:11:04,305 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39075,1689455452043 2023-07-15 21:11:04,305 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39587,1689455451998 2023-07-15 21:11:04,305 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37853,1689455451932 2023-07-15 21:11:04,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 21:11:04,306 DEBUG [(jenkins-hbase4.apache.org,36465,1689455450507)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36465-0x1016ad2d8bb0000, quorum=127.0.0.1:50024, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39075,1689455452043 2023-07-15 21:11:04,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-15 21:11:04,307 DEBUG [(jenkins-hbase4.apache.org,36465,1689455450507)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36465-0x1016ad2d8bb0000, quorum=127.0.0.1:50024, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39587,1689455451998 2023-07-15 21:11:04,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39075,1689455452043 2023-07-15 21:11:04,307 DEBUG [(jenkins-hbase4.apache.org,36465,1689455450507)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36465-0x1016ad2d8bb0000, quorum=127.0.0.1:50024, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,37853,1689455451932 2023-07-15 21:11:04,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39587,1689455451998 2023-07-15 21:11:04,308 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37853,1689455451932 2023-07-15 21:11:04,329 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): regionserver:37853-0x1016ad2d8bb0001, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 21:11:04,329 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): regionserver:39075-0x1016ad2d8bb0003, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 21:11:04,330 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): master:36465-0x1016ad2d8bb0000, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,37853,1689455451932 2023-07-15 21:11:04,329 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 21:11:04,330 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 21:11:04,330 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportWithTargetName 2023-07-15 21:11:04,330 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): regionserver:39587-0x1016ad2d8bb0002, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 21:11:04,330 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): regionserver:37853-0x1016ad2d8bb0001, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 21:11:04,330 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 21:11:04,330 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): master:36465-0x1016ad2d8bb0000, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-15 21:11:04,330 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 21:11:04,330 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): regionserver:39587-0x1016ad2d8bb0002, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 21:11:04,330 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportWithTargetName 2023-07-15 21:11:04,330 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): regionserver:39075-0x1016ad2d8bb0003, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 21:11:04,330 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 90c8eeaaf01a24f585da11044309be71, NAME => 'testtb-testExportWithTargetName,.mob,0.90c8eeaaf01a24f585da11044309be71.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportWithTargetName 2023-07-15 21:11:04,331 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-15 21:11:04,331 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 21:11:04,331 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 21:11:04,330 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 21:11:04,331 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 21:11:04,330 DEBUG [(jenkins-hbase4.apache.org,36465,1689455450507)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 21:11:04,330 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): master:36465-0x1016ad2d8bb0000, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39587,1689455451998 2023-07-15 21:11:04,331 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): master:36465-0x1016ad2d8bb0000, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39075,1689455452043 2023-07-15 21:11:04,331 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): master:36465-0x1016ad2d8bb0000, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-15 21:11:04,332 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): master:36465-0x1016ad2d8bb0000, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,37853,1689455451932 2023-07-15 21:11:04,332 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 21:11:04,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 21:11:04,332 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): master:36465-0x1016ad2d8bb0000, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-15 21:11:04,332 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): master:36465-0x1016ad2d8bb0000, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39587,1689455451998 2023-07-15 21:11:04,332 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): master:36465-0x1016ad2d8bb0000, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39075,1689455452043 2023-07-15 21:11:04,332 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): master:36465-0x1016ad2d8bb0000, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-15 21:11:04,332 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): master:36465-0x1016ad2d8bb0000, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-15 21:11:04,332 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b20230715f4db63a1eab64ba092bd63d649e778cc, hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e20230715e5d26f18d8fa4e58a1ffe6ae9a889aaf] mob files 2023-07-15 21:11:04,332 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b20230715f4db63a1eab64ba092bd63d649e778cc 2023-07-15 21:11:04,333 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e20230715e5d26f18d8fa4e58a1ffe6ae9a889aaf 2023-07-15 21:11:04,333 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 21:11:04,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 21:11:04,371 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportWithTargetName 2023-07-15 21:11:04,372 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-07-15 21:11:04,413 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName to hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/.hbase-snapshot/snaptb0-testExportWithTargetName 2023-07-15 21:11:04,482 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed 2023-07-15 21:11:04,483 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-07-15 21:11:04,483 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-07-15 21:11:04,483 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName at 1689455463655Completed referencing HFiles for the mob region of table: testtb-testExportWithTargetName at 1689455464371 (+716 ms)Consolidate snapshot: snaptb0-testExportWithTargetName at 1689455464371Loading Region manifests for snaptb0-testExportWithTargetName at 1689455464371Writing data manifest for snaptb0-testExportWithTargetName at 1689455464380 (+9 ms)Verifying snapshot: snaptb0-testExportWithTargetName at 1689455464399 (+19 ms)Snapshot snaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed at 1689455464482 (+83 ms) 2023-07-15 21:11:04,486 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=20, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-15 21:11:04,489 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=20, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED in 830 msec 2023-07-15 21:11:04,766 DEBUG [Listener at jenkins-hbase4.apache.org/41711] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-15 21:11:04,769 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36465] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-15 21:11:04,769 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36465] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-15 21:11:04,770 INFO [Listener at jenkins-hbase4.apache.org/41711] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/export-test/export-1689455464770 2023-07-15 21:11:04,771 INFO [Listener at jenkins-hbase4.apache.org/41711] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:46859, tgtDir=hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/export-test/export-1689455464770, rawTgtDir=hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/export-test/export-1689455464770, srcFsUri=hdfs://localhost:46859, srcDir=hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313 2023-07-15 21:11:04,825 DEBUG [Listener at jenkins-hbase4.apache.org/41711] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:46859, inputRoot=hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313 2023-07-15 21:11:04,825 DEBUG [Listener at jenkins-hbase4.apache.org/41711] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-916460841_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/export-test/export-1689455464770, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/export-test/export-1689455464770/.hbase-snapshot/.tmp/testExportWithTargetName 2023-07-15 21:11:04,825 INFO [Listener at jenkins-hbase4.apache.org/41711] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:46859, inputRoot=hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313, snapshotDir=hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/.hbase-snapshot/snaptb0-testExportWithTargetName. 2023-07-15 21:11:04,865 INFO [Listener at jenkins-hbase4.apache.org/41711] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/.hbase-snapshot/snaptb0-testExportWithTargetName to hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/export-test/export-1689455464770/.hbase-snapshot/.tmp/testExportWithTargetName 2023-07-15 21:11:04,942 DEBUG [Listener at jenkins-hbase4.apache.org/41711] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-15 21:11:04,942 DEBUG [Listener at jenkins-hbase4.apache.org/41711] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-15 21:11:04,943 DEBUG [Listener at jenkins-hbase4.apache.org/41711] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-15 21:11:04,944 DEBUG [Listener at jenkins-hbase4.apache.org/41711] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-15 21:11:04,944 DEBUG [Listener at jenkins-hbase4.apache.org/41711] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-15 21:11:04,945 DEBUG [Listener at jenkins-hbase4.apache.org/41711] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-15 21:11:04,945 DEBUG [Listener at jenkins-hbase4.apache.org/41711] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-15 21:11:05,022 DEBUG [Listener at jenkins-hbase4.apache.org/41711] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/de3e87f0-08fc-c0d0-c969-4c410fd4e6fd/hadoop-3721315939774129770.jar 2023-07-15 21:11:05,022 DEBUG [Listener at jenkins-hbase4.apache.org/41711] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-15 21:11:05,023 DEBUG [Listener at jenkins-hbase4.apache.org/41711] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-15 21:11:05,023 DEBUG [Listener at jenkins-hbase4.apache.org/41711] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-15 21:11:05,024 DEBUG [Listener at jenkins-hbase4.apache.org/41711] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-15 21:11:05,024 DEBUG [Listener at jenkins-hbase4.apache.org/41711] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-15 21:11:05,025 DEBUG [Listener at jenkins-hbase4.apache.org/41711] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-15 21:11:05,025 DEBUG [Listener at jenkins-hbase4.apache.org/41711] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-15 21:11:05,026 DEBUG [Listener at jenkins-hbase4.apache.org/41711] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-15 21:11:05,027 DEBUG [Listener at jenkins-hbase4.apache.org/41711] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-15 21:11:05,027 DEBUG [Listener at jenkins-hbase4.apache.org/41711] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-15 21:11:05,028 DEBUG [Listener at jenkins-hbase4.apache.org/41711] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-15 21:11:05,029 DEBUG [Listener at jenkins-hbase4.apache.org/41711] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-15 21:11:05,029 DEBUG [Listener at jenkins-hbase4.apache.org/41711] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-15 21:11:05,030 DEBUG [Listener at jenkins-hbase4.apache.org/41711] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-15 21:11:05,031 DEBUG [Listener at jenkins-hbase4.apache.org/41711] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-15 21:11:05,031 DEBUG [Listener at jenkins-hbase4.apache.org/41711] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-15 21:11:05,035 DEBUG [Listener at jenkins-hbase4.apache.org/41711] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-15 21:11:05,036 DEBUG [Listener at jenkins-hbase4.apache.org/41711] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-15 21:11:05,037 DEBUG [Listener at jenkins-hbase4.apache.org/41711] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-15 21:11:05,037 DEBUG [Listener at jenkins-hbase4.apache.org/41711] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-15 21:11:05,037 DEBUG [Listener at jenkins-hbase4.apache.org/41711] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-15 21:11:05,038 DEBUG [Listener at jenkins-hbase4.apache.org/41711] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-15 21:11:05,038 DEBUG [Listener at jenkins-hbase4.apache.org/41711] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-15 21:11:06,377 WARN [Listener at jenkins-hbase4.apache.org/41711] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-15 21:11:06,384 INFO [Listener at jenkins-hbase4.apache.org/41711] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportWithTargetName' hfile list 2023-07-15 21:11:06,394 DEBUG [Listener at jenkins-hbase4.apache.org/41711] snapshot.ExportSnapshot(671): export split=0 size=30.9 K 2023-07-15 21:11:06,881 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-15 21:11:06,883 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-15 21:11:07,191 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-15 21:11:07,217 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689455459463_0001_000001 (auth:SIMPLE) 2023-07-15 21:11:12,536 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689455459463_0001_000001 (auth:SIMPLE) 2023-07-15 21:11:14,795 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689455459463_0001_000001 (auth:SIMPLE) 2023-07-15 21:11:18,688 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689455459463_0001_000001 (auth:SIMPLE) 2023-07-15 21:11:20,278 INFO [Listener at jenkins-hbase4.apache.org/41711] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-15 21:11:20,280 INFO [Listener at jenkins-hbase4.apache.org/41711] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-15 21:11:20,291 INFO [Listener at jenkins-hbase4.apache.org/41711] snapshot.ExportSnapshot(1127): Export Completed: testExportWithTargetName 2023-07-15 21:11:20,291 INFO [Listener at jenkins-hbase4.apache.org/41711] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-15 21:11:20,292 INFO [Listener at jenkins-hbase4.apache.org/41711] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-15 21:11:20,292 DEBUG [Listener at jenkins-hbase4.apache.org/41711] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1600112846_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/.hbase-snapshot/snaptb0-testExportWithTargetName at hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/.hbase-snapshot/snaptb0-testExportWithTargetName 2023-07-15 21:11:20,293 DEBUG [Listener at jenkins-hbase4.apache.org/41711] snapshot.TestExportSnapshot(367): hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/.hbase-snapshot/snaptb0-testExportWithTargetName/.snapshotinfo 2023-07-15 21:11:20,293 DEBUG [Listener at jenkins-hbase4.apache.org/41711] snapshot.TestExportSnapshot(367): hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/.hbase-snapshot/snaptb0-testExportWithTargetName/data.manifest 2023-07-15 21:11:20,293 DEBUG [Listener at jenkins-hbase4.apache.org/41711] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1600112846_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/export-test/export-1689455464770/.hbase-snapshot/testExportWithTargetName at hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/export-test/export-1689455464770/.hbase-snapshot/testExportWithTargetName 2023-07-15 21:11:20,293 DEBUG [Listener at jenkins-hbase4.apache.org/41711] snapshot.TestExportSnapshot(367): hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/export-test/export-1689455464770/.hbase-snapshot/testExportWithTargetName/.snapshotinfo 2023-07-15 21:11:20,293 DEBUG [Listener at jenkins-hbase4.apache.org/41711] snapshot.TestExportSnapshot(367): hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/export-test/export-1689455464770/.hbase-snapshot/testExportWithTargetName/data.manifest 2023-07-15 21:11:20,304 INFO [Listener at jenkins-hbase4.apache.org/41711] client.HBaseAdmin$15(890): Started disable of testtb-testExportWithTargetName 2023-07-15 21:11:20,309 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36465] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportWithTargetName 2023-07-15 21:11:20,319 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36465] procedure2.ProcedureExecutor(1029): Stored pid=21, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportWithTargetName 2023-07-15 21:11:20,324 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689455480324"}]},"ts":"1689455480324"} 2023-07-15 21:11:20,325 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36465] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-07-15 21:11:20,326 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=DISABLING in hbase:meta 2023-07-15 21:11:20,329 INFO [PEWorker-3] procedure.DisableTableProcedure(293): Set testtb-testExportWithTargetName to state=DISABLING 2023-07-15 21:11:20,332 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=22, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=02d9b37da6522e108c062b61df6e3707, UNASSIGN}, {pid=23, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=7d9eedcece667f4c6074fc0931e96f3a, UNASSIGN}] 2023-07-15 21:11:20,333 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=22, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=02d9b37da6522e108c062b61df6e3707, UNASSIGN 2023-07-15 21:11:20,335 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=23, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=7d9eedcece667f4c6074fc0931e96f3a, UNASSIGN 2023-07-15 21:11:20,337 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=22 updating hbase:meta row=02d9b37da6522e108c062b61df6e3707, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,39075,1689455452043 2023-07-15 21:11:20,337 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=23 updating hbase:meta row=7d9eedcece667f4c6074fc0931e96f3a, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,39587,1689455451998 2023-07-15 21:11:20,337 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,,1689455461178.02d9b37da6522e108c062b61df6e3707.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689455480336"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689455480336"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689455480336"}]},"ts":"1689455480336"} 2023-07-15 21:11:20,337 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,1,1689455461178.7d9eedcece667f4c6074fc0931e96f3a.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689455480336"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689455480336"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689455480336"}]},"ts":"1689455480336"} 2023-07-15 21:11:20,342 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=24, ppid=22, state=RUNNABLE; CloseRegionProcedure 02d9b37da6522e108c062b61df6e3707, server=jenkins-hbase4.apache.org,39075,1689455452043}] 2023-07-15 21:11:20,342 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=25, ppid=23, state=RUNNABLE; CloseRegionProcedure 7d9eedcece667f4c6074fc0931e96f3a, server=jenkins-hbase4.apache.org,39587,1689455451998}] 2023-07-15 21:11:20,427 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36465] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-07-15 21:11:20,506 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 02d9b37da6522e108c062b61df6e3707 2023-07-15 21:11:20,506 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 7d9eedcece667f4c6074fc0931e96f3a 2023-07-15 21:11:20,506 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 02d9b37da6522e108c062b61df6e3707, disabling compactions & flushes 2023-07-15 21:11:20,506 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 7d9eedcece667f4c6074fc0931e96f3a, disabling compactions & flushes 2023-07-15 21:11:20,506 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,,1689455461178.02d9b37da6522e108c062b61df6e3707. 2023-07-15 21:11:20,506 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,1,1689455461178.7d9eedcece667f4c6074fc0931e96f3a. 2023-07-15 21:11:20,506 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,,1689455461178.02d9b37da6522e108c062b61df6e3707. 2023-07-15 21:11:20,506 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,1,1689455461178.7d9eedcece667f4c6074fc0931e96f3a. 2023-07-15 21:11:20,506 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,,1689455461178.02d9b37da6522e108c062b61df6e3707. after waiting 0 ms 2023-07-15 21:11:20,507 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,,1689455461178.02d9b37da6522e108c062b61df6e3707. 2023-07-15 21:11:20,506 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,1,1689455461178.7d9eedcece667f4c6074fc0931e96f3a. after waiting 0 ms 2023-07-15 21:11:20,507 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,1,1689455461178.7d9eedcece667f4c6074fc0931e96f3a. 2023-07-15 21:11:20,531 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/data/default/testtb-testExportWithTargetName/7d9eedcece667f4c6074fc0931e96f3a/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-15 21:11:20,532 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-15 21:11:20,532 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/data/default/testtb-testExportWithTargetName/02d9b37da6522e108c062b61df6e3707/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-15 21:11:20,534 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,1,1689455461178.7d9eedcece667f4c6074fc0931e96f3a. 2023-07-15 21:11:20,534 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 7d9eedcece667f4c6074fc0931e96f3a: 2023-07-15 21:11:20,534 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-15 21:11:20,535 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,,1689455461178.02d9b37da6522e108c062b61df6e3707. 2023-07-15 21:11:20,535 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 02d9b37da6522e108c062b61df6e3707: 2023-07-15 21:11:20,538 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 7d9eedcece667f4c6074fc0931e96f3a 2023-07-15 21:11:20,538 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=23 updating hbase:meta row=7d9eedcece667f4c6074fc0931e96f3a, regionState=CLOSED 2023-07-15 21:11:20,539 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,1,1689455461178.7d9eedcece667f4c6074fc0931e96f3a.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689455480538"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689455480538"}]},"ts":"1689455480538"} 2023-07-15 21:11:20,539 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 02d9b37da6522e108c062b61df6e3707 2023-07-15 21:11:20,539 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=22 updating hbase:meta row=02d9b37da6522e108c062b61df6e3707, regionState=CLOSED 2023-07-15 21:11:20,540 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,,1689455461178.02d9b37da6522e108c062b61df6e3707.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689455480539"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689455480539"}]},"ts":"1689455480539"} 2023-07-15 21:11:20,544 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=25, resume processing ppid=23 2023-07-15 21:11:20,544 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=25, ppid=23, state=SUCCESS; CloseRegionProcedure 7d9eedcece667f4c6074fc0931e96f3a, server=jenkins-hbase4.apache.org,39587,1689455451998 in 199 msec 2023-07-15 21:11:20,545 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=24, resume processing ppid=22 2023-07-15 21:11:20,545 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=24, ppid=22, state=SUCCESS; CloseRegionProcedure 02d9b37da6522e108c062b61df6e3707, server=jenkins-hbase4.apache.org,39075,1689455452043 in 199 msec 2023-07-15 21:11:20,546 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=23, ppid=21, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=7d9eedcece667f4c6074fc0931e96f3a, UNASSIGN in 212 msec 2023-07-15 21:11:20,548 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=22, resume processing ppid=21 2023-07-15 21:11:20,548 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=22, ppid=21, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=02d9b37da6522e108c062b61df6e3707, UNASSIGN in 213 msec 2023-07-15 21:11:20,549 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689455480549"}]},"ts":"1689455480549"} 2023-07-15 21:11:20,550 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=DISABLED in hbase:meta 2023-07-15 21:11:20,552 INFO [PEWorker-3] procedure.DisableTableProcedure(305): Set testtb-testExportWithTargetName to state=DISABLED 2023-07-15 21:11:20,555 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=21, state=SUCCESS; DisableTableProcedure table=testtb-testExportWithTargetName in 241 msec 2023-07-15 21:11:20,628 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36465] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-07-15 21:11:20,629 INFO [Listener at jenkins-hbase4.apache.org/41711] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportWithTargetName, procId: 21 completed 2023-07-15 21:11:20,634 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36465] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportWithTargetName 2023-07-15 21:11:20,640 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36465] procedure2.ProcedureExecutor(1029): Stored pid=26, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-15 21:11:20,643 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=26, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-15 21:11:20,645 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36465] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportWithTargetName 2023-07-15 21:11:20,645 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=26, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-15 21:11:20,649 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=39075] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportWithTargetName 2023-07-15 21:11:20,652 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): regionserver:39075-0x1016ad2d8bb0003, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-15 21:11:20,652 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): master:36465-0x1016ad2d8bb0000, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-15 21:11:20,652 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): regionserver:37853-0x1016ad2d8bb0001, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-15 21:11:20,652 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): regionserver:39587-0x1016ad2d8bb0002, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-15 21:11:20,652 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/.tmp/data/default/testtb-testExportWithTargetName/02d9b37da6522e108c062b61df6e3707 2023-07-15 21:11:20,652 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/.tmp/data/default/testtb-testExportWithTargetName/7d9eedcece667f4c6074fc0931e96f3a 2023-07-15 21:11:20,652 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF 2023-07-15 21:11:20,652 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF 2023-07-15 21:11:20,653 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF 2023-07-15 21:11:20,653 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF 2023-07-15 21:11:20,655 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): regionserver:39075-0x1016ad2d8bb0003, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-15 21:11:20,655 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): regionserver:39075-0x1016ad2d8bb0003, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 21:11:20,655 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): regionserver:37853-0x1016ad2d8bb0001, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-15 21:11:20,655 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): regionserver:37853-0x1016ad2d8bb0001, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 21:11:20,655 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): master:36465-0x1016ad2d8bb0000, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-15 21:11:20,655 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): master:36465-0x1016ad2d8bb0000, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 21:11:20,655 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): regionserver:39587-0x1016ad2d8bb0002, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-15 21:11:20,655 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): regionserver:39587-0x1016ad2d8bb0002, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 21:11:20,656 DEBUG [HFileArchiver-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/.tmp/data/default/testtb-testExportWithTargetName/02d9b37da6522e108c062b61df6e3707/cf, FileablePath, hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/.tmp/data/default/testtb-testExportWithTargetName/02d9b37da6522e108c062b61df6e3707/recovered.edits] 2023-07-15 21:11:20,656 DEBUG [HFileArchiver-6] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/.tmp/data/default/testtb-testExportWithTargetName/7d9eedcece667f4c6074fc0931e96f3a/cf, FileablePath, hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/.tmp/data/default/testtb-testExportWithTargetName/7d9eedcece667f4c6074fc0931e96f3a/recovered.edits] 2023-07-15 21:11:20,660 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36465] master.MasterRpcServices(1230): Checking to see if procedure is done pid=26 2023-07-15 21:11:20,666 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/.tmp/data/default/testtb-testExportWithTargetName/02d9b37da6522e108c062b61df6e3707/cf/ea3656847b1d400186924df2a91c0103 to hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/archive/data/default/testtb-testExportWithTargetName/02d9b37da6522e108c062b61df6e3707/cf/ea3656847b1d400186924df2a91c0103 2023-07-15 21:11:20,666 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/.tmp/data/default/testtb-testExportWithTargetName/7d9eedcece667f4c6074fc0931e96f3a/cf/607ccb375ce14e22a829aafc1c5f4104 to hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/archive/data/default/testtb-testExportWithTargetName/7d9eedcece667f4c6074fc0931e96f3a/cf/607ccb375ce14e22a829aafc1c5f4104 2023-07-15 21:11:20,671 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/.tmp/data/default/testtb-testExportWithTargetName/02d9b37da6522e108c062b61df6e3707/recovered.edits/9.seqid to hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/archive/data/default/testtb-testExportWithTargetName/02d9b37da6522e108c062b61df6e3707/recovered.edits/9.seqid 2023-07-15 21:11:20,672 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/.tmp/data/default/testtb-testExportWithTargetName/7d9eedcece667f4c6074fc0931e96f3a/recovered.edits/9.seqid to hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/archive/data/default/testtb-testExportWithTargetName/7d9eedcece667f4c6074fc0931e96f3a/recovered.edits/9.seqid 2023-07-15 21:11:20,672 DEBUG [HFileArchiver-5] backup.HFileArchiver(596): Deleted hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/.tmp/data/default/testtb-testExportWithTargetName/02d9b37da6522e108c062b61df6e3707 2023-07-15 21:11:20,672 DEBUG [HFileArchiver-6] backup.HFileArchiver(596): Deleted hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/.tmp/data/default/testtb-testExportWithTargetName/7d9eedcece667f4c6074fc0931e96f3a 2023-07-15 21:11:20,672 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testExportWithTargetName regions 2023-07-15 21:11:20,673 DEBUG [PEWorker-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71 2023-07-15 21:11:20,674 DEBUG [PEWorker-4] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf] 2023-07-15 21:11:20,680 DEBUG [PEWorker-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b20230715f4db63a1eab64ba092bd63d649e778cc to hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/archive/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b20230715f4db63a1eab64ba092bd63d649e778cc 2023-07-15 21:11:20,681 DEBUG [PEWorker-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e20230715e5d26f18d8fa4e58a1ffe6ae9a889aaf to hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/archive/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e20230715e5d26f18d8fa4e58a1ffe6ae9a889aaf 2023-07-15 21:11:20,682 DEBUG [PEWorker-4] backup.HFileArchiver(596): Deleted hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71 2023-07-15 21:11:20,685 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=26, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-15 21:11:20,709 WARN [PEWorker-4] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportWithTargetName from hbase:meta 2023-07-15 21:11:20,713 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportWithTargetName' descriptor. 2023-07-15 21:11:20,714 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=26, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-15 21:11:20,714 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportWithTargetName' from region states. 2023-07-15 21:11:20,715 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName,,1689455461178.02d9b37da6522e108c062b61df6e3707.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689455480714"}]},"ts":"9223372036854775807"} 2023-07-15 21:11:20,715 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName,1,1689455461178.7d9eedcece667f4c6074fc0931e96f3a.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689455480714"}]},"ts":"9223372036854775807"} 2023-07-15 21:11:20,717 INFO [PEWorker-4] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-15 21:11:20,717 DEBUG [PEWorker-4] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 02d9b37da6522e108c062b61df6e3707, NAME => 'testtb-testExportWithTargetName,,1689455461178.02d9b37da6522e108c062b61df6e3707.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 7d9eedcece667f4c6074fc0931e96f3a, NAME => 'testtb-testExportWithTargetName,1,1689455461178.7d9eedcece667f4c6074fc0931e96f3a.', STARTKEY => '1', ENDKEY => ''}] 2023-07-15 21:11:20,717 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportWithTargetName' as deleted. 2023-07-15 21:11:20,717 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689455480717"}]},"ts":"9223372036854775807"} 2023-07-15 21:11:20,720 INFO [PEWorker-4] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportWithTargetName state from META 2023-07-15 21:11:20,722 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(130): Finished pid=26, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-15 21:11:20,724 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=26, state=SUCCESS; DeleteTableProcedure table=testtb-testExportWithTargetName in 87 msec 2023-07-15 21:11:20,762 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36465] master.MasterRpcServices(1230): Checking to see if procedure is done pid=26 2023-07-15 21:11:20,764 INFO [Listener at jenkins-hbase4.apache.org/41711] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportWithTargetName, procId: 26 completed 2023-07-15 21:11:20,784 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36465] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportWithTargetName" 2023-07-15 21:11:20,786 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36465] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportWithTargetName 2023-07-15 21:11:20,789 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36465] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportWithTargetName" 2023-07-15 21:11:20,791 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36465] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportWithTargetName 2023-07-15 21:11:20,820 INFO [Listener at jenkins-hbase4.apache.org/41711] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportWithTargetName Thread=753 (was 706) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: htable-pool-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: (jenkins-hbase4.apache.org,36465,1689455450507)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/de3e87f0-08fc-c0d0-c969-4c410fd4e6fd/cluster_474a310c-7bd1-3ce2-91d1-9793d9692166/dfs/data/data5/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-4 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (2038956992) connection to jenkins-hbase4.apache.org/172.31.14.131:42277 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: DeletionService #3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x401a2f8d-shared-pool-12 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/de3e87f0-08fc-c0d0-c969-4c410fd4e6fd/cluster_474a310c-7bd1-3ce2-91d1-9793d9692166/dfs/data/data2/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,39587,1689455451998' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,39075,1689455452043' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1600112846_17 at /127.0.0.1:50396 [Waiting for operation #6] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1600112846_17 at /127.0.0.1:38514 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/de3e87f0-08fc-c0d0-c969-4c410fd4e6fd/cluster_474a310c-7bd1-3ce2-91d1-9793d9692166/dfs/data/data3/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ContainersLauncher #0 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.read1(BufferedReader.java:212) java.io.BufferedReader.read(BufferedReader.java:286) org.apache.hadoop.util.Shell$ShellCommandExecutor.parseExecResult(Shell.java:1229) org.apache.hadoop.util.Shell.runCommand(Shell.java:984) org.apache.hadoop.util.Shell.run(Shell.java:884) org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:1216) org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.launchContainer(DefaultContainerExecutor.java:294) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.launchContainer(ContainerLaunch.java:442) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:293) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:97) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/de3e87f0-08fc-c0d0-c969-4c410fd4e6fd/cluster_474a310c-7bd1-3ce2-91d1-9793d9692166/dfs/data/data4/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ContainersLauncher #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/de3e87f0-08fc-c0d0-c969-4c410fd4e6fd/cluster_474a310c-7bd1-3ce2-91d1-9793d9692166/dfs/data/data6/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-1315 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: HFileArchiver-6 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (2038956992) connection to jenkins-hbase4.apache.org/172.31.14.131:34089 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_639947808_1 at /127.0.0.1:55942 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x401a2f8d-shared-pool-11 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1600112846_17 at /127.0.0.1:55948 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/de3e87f0-08fc-c0d0-c969-4c410fd4e6fd/cluster_474a310c-7bd1-3ce2-91d1-9793d9692166/dfs/data/data1/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (2038956992) connection to jenkins-hbase4.apache.org/172.31.14.131:42345 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: DeletionService #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-2 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Container metrics unregistration java.lang.Object.wait(Native Method) java.util.TimerThread.mainLoop(Timer.java:552) java.util.TimerThread.run(Timer.java:505) Potentially hanging thread: htable-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,37853,1689455451932' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-5 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x401a2f8d-shared-pool-9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-3 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_639947808_1 at /127.0.0.1:51122 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x401a2f8d-shared-pool-10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MutableQuantiles-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=931 (was 903) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=303 (was 293) - SystemLoadAverage LEAK? -, ProcessCount=180 (was 174) - ProcessCount LEAK? -, AvailableMemoryMB=3217 (was 4847) 2023-07-15 21:11:20,821 WARN [Listener at jenkins-hbase4.apache.org/41711] hbase.ResourceChecker(130): Thread=753 is superior to 500 2023-07-15 21:11:20,843 INFO [Listener at jenkins-hbase4.apache.org/41711] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportFileSystemState Thread=753, OpenFileDescriptor=931, MaxFileDescriptor=60000, SystemLoadAverage=303, ProcessCount=180, AvailableMemoryMB=3216 2023-07-15 21:11:20,843 WARN [Listener at jenkins-hbase4.apache.org/41711] hbase.ResourceChecker(130): Thread=753 is superior to 500 2023-07-15 21:11:20,845 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36465] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-07-15 21:11:20,848 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36465] procedure2.ProcedureExecutor(1029): Stored pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemState 2023-07-15 21:11:20,851 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_PRE_OPERATION 2023-07-15 21:11:20,852 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36465] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemState" procId is: 27 2023-07-15 21:11:20,853 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-15 21:11:20,853 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36465] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-15 21:11:20,856 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/.tmp/data/default/testtb-testExportFileSystemState/faf012332edd8fd89b4f1b924a8cd490 2023-07-15 21:11:20,856 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/.tmp/data/default/testtb-testExportFileSystemState/1e1f50649aa7248f9da070059fc4ce7d 2023-07-15 21:11:20,856 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/.tmp/data/default/testtb-testExportFileSystemState/faf012332edd8fd89b4f1b924a8cd490 empty. 2023-07-15 21:11:20,856 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/.tmp/data/default/testtb-testExportFileSystemState/1e1f50649aa7248f9da070059fc4ce7d empty. 2023-07-15 21:11:20,857 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/.tmp/data/default/testtb-testExportFileSystemState/1e1f50649aa7248f9da070059fc4ce7d 2023-07-15 21:11:20,857 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/.tmp/data/default/testtb-testExportFileSystemState/faf012332edd8fd89b4f1b924a8cd490 2023-07-15 21:11:20,857 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemState regions 2023-07-15 21:11:20,869 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/.tmp/data/default/testtb-testExportFileSystemState/.tabledesc/.tableinfo.0000000001 2023-07-15 21:11:20,870 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(7675): creating {ENCODED => faf012332edd8fd89b4f1b924a8cd490, NAME => 'testtb-testExportFileSystemState,,1689455480845.faf012332edd8fd89b4f1b924a8cd490.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/.tmp 2023-07-15 21:11:20,871 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(7675): creating {ENCODED => 1e1f50649aa7248f9da070059fc4ce7d, NAME => 'testtb-testExportFileSystemState,1,1689455480845.1e1f50649aa7248f9da070059fc4ce7d.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/.tmp 2023-07-15 21:11:20,890 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,,1689455480845.faf012332edd8fd89b4f1b924a8cd490.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-15 21:11:20,891 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1604): Closing faf012332edd8fd89b4f1b924a8cd490, disabling compactions & flushes 2023-07-15 21:11:20,891 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,,1689455480845.faf012332edd8fd89b4f1b924a8cd490. 2023-07-15 21:11:20,891 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,,1689455480845.faf012332edd8fd89b4f1b924a8cd490. 2023-07-15 21:11:20,891 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,,1689455480845.faf012332edd8fd89b4f1b924a8cd490. after waiting 0 ms 2023-07-15 21:11:20,891 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,,1689455480845.faf012332edd8fd89b4f1b924a8cd490. 2023-07-15 21:11:20,891 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,,1689455480845.faf012332edd8fd89b4f1b924a8cd490. 2023-07-15 21:11:20,891 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1558): Region close journal for faf012332edd8fd89b4f1b924a8cd490: 2023-07-15 21:11:20,893 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,1,1689455480845.1e1f50649aa7248f9da070059fc4ce7d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-15 21:11:20,895 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1604): Closing 1e1f50649aa7248f9da070059fc4ce7d, disabling compactions & flushes 2023-07-15 21:11:20,895 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,1,1689455480845.1e1f50649aa7248f9da070059fc4ce7d. 2023-07-15 21:11:20,895 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,1,1689455480845.1e1f50649aa7248f9da070059fc4ce7d. 2023-07-15 21:11:20,895 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,1,1689455480845.1e1f50649aa7248f9da070059fc4ce7d. after waiting 0 ms 2023-07-15 21:11:20,895 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,1,1689455480845.1e1f50649aa7248f9da070059fc4ce7d. 2023-07-15 21:11:20,895 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,1,1689455480845.1e1f50649aa7248f9da070059fc4ce7d. 2023-07-15 21:11:20,895 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1558): Region close journal for 1e1f50649aa7248f9da070059fc4ce7d: 2023-07-15 21:11:20,898 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_ADD_TO_META 2023-07-15 21:11:20,899 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,,1689455480845.faf012332edd8fd89b4f1b924a8cd490.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689455480899"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689455480899"}]},"ts":"1689455480899"} 2023-07-15 21:11:20,899 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,1,1689455480845.1e1f50649aa7248f9da070059fc4ce7d.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689455480899"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689455480899"}]},"ts":"1689455480899"} 2023-07-15 21:11:20,902 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-15 21:11:20,903 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-15 21:11:20,903 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689455480903"}]},"ts":"1689455480903"} 2023-07-15 21:11:20,905 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=ENABLING in hbase:meta 2023-07-15 21:11:20,908 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-15 21:11:20,909 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-15 21:11:20,909 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-15 21:11:20,909 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-15 21:11:20,909 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-15 21:11:20,909 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=faf012332edd8fd89b4f1b924a8cd490, ASSIGN}, {pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=1e1f50649aa7248f9da070059fc4ce7d, ASSIGN}] 2023-07-15 21:11:20,912 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=1e1f50649aa7248f9da070059fc4ce7d, ASSIGN 2023-07-15 21:11:20,912 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=faf012332edd8fd89b4f1b924a8cd490, ASSIGN 2023-07-15 21:11:20,913 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=1e1f50649aa7248f9da070059fc4ce7d, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,39075,1689455452043; forceNewPlan=false, retain=false 2023-07-15 21:11:20,913 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=faf012332edd8fd89b4f1b924a8cd490, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,37853,1689455451932; forceNewPlan=false, retain=false 2023-07-15 21:11:20,954 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36465] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-15 21:11:21,063 INFO [jenkins-hbase4:36465] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-15 21:11:21,066 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=1e1f50649aa7248f9da070059fc4ce7d, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,39075,1689455452043 2023-07-15 21:11:21,066 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=faf012332edd8fd89b4f1b924a8cd490, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,37853,1689455451932 2023-07-15 21:11:21,066 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,1,1689455480845.1e1f50649aa7248f9da070059fc4ce7d.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689455481066"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689455481066"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689455481066"}]},"ts":"1689455481066"} 2023-07-15 21:11:21,066 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,,1689455480845.faf012332edd8fd89b4f1b924a8cd490.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689455481066"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689455481066"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689455481066"}]},"ts":"1689455481066"} 2023-07-15 21:11:21,069 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=30, ppid=29, state=RUNNABLE; OpenRegionProcedure 1e1f50649aa7248f9da070059fc4ce7d, server=jenkins-hbase4.apache.org,39075,1689455452043}] 2023-07-15 21:11:21,070 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=31, ppid=28, state=RUNNABLE; OpenRegionProcedure faf012332edd8fd89b4f1b924a8cd490, server=jenkins-hbase4.apache.org,37853,1689455451932}] 2023-07-15 21:11:21,156 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36465] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-15 21:11:21,225 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemState,1,1689455480845.1e1f50649aa7248f9da070059fc4ce7d. 2023-07-15 21:11:21,225 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1e1f50649aa7248f9da070059fc4ce7d, NAME => 'testtb-testExportFileSystemState,1,1689455480845.1e1f50649aa7248f9da070059fc4ce7d.', STARTKEY => '1', ENDKEY => ''} 2023-07-15 21:11:21,227 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemState,1,1689455480845.1e1f50649aa7248f9da070059fc4ce7d. service=AccessControlService 2023-07-15 21:11:21,227 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,37853,1689455451932 2023-07-15 21:11:21,227 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-15 21:11:21,227 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemState 1e1f50649aa7248f9da070059fc4ce7d 2023-07-15 21:11:21,227 DEBUG [RSProcedureDispatcher-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-15 21:11:21,227 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,1,1689455480845.1e1f50649aa7248f9da070059fc4ce7d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-15 21:11:21,228 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 1e1f50649aa7248f9da070059fc4ce7d 2023-07-15 21:11:21,228 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 1e1f50649aa7248f9da070059fc4ce7d 2023-07-15 21:11:21,232 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:45578, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-15 21:11:21,233 INFO [StoreOpener-1e1f50649aa7248f9da070059fc4ce7d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 1e1f50649aa7248f9da070059fc4ce7d 2023-07-15 21:11:21,236 DEBUG [StoreOpener-1e1f50649aa7248f9da070059fc4ce7d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/data/default/testtb-testExportFileSystemState/1e1f50649aa7248f9da070059fc4ce7d/cf 2023-07-15 21:11:21,236 DEBUG [StoreOpener-1e1f50649aa7248f9da070059fc4ce7d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/data/default/testtb-testExportFileSystemState/1e1f50649aa7248f9da070059fc4ce7d/cf 2023-07-15 21:11:21,237 INFO [StoreOpener-1e1f50649aa7248f9da070059fc4ce7d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1e1f50649aa7248f9da070059fc4ce7d columnFamilyName cf 2023-07-15 21:11:21,239 INFO [StoreOpener-1e1f50649aa7248f9da070059fc4ce7d-1] regionserver.HStore(310): Store=1e1f50649aa7248f9da070059fc4ce7d/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-15 21:11:21,240 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemState,,1689455480845.faf012332edd8fd89b4f1b924a8cd490. 2023-07-15 21:11:21,241 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => faf012332edd8fd89b4f1b924a8cd490, NAME => 'testtb-testExportFileSystemState,,1689455480845.faf012332edd8fd89b4f1b924a8cd490.', STARTKEY => '', ENDKEY => '1'} 2023-07-15 21:11:21,241 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/data/default/testtb-testExportFileSystemState/1e1f50649aa7248f9da070059fc4ce7d 2023-07-15 21:11:21,242 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemState,,1689455480845.faf012332edd8fd89b4f1b924a8cd490. service=AccessControlService 2023-07-15 21:11:21,242 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/data/default/testtb-testExportFileSystemState/1e1f50649aa7248f9da070059fc4ce7d 2023-07-15 21:11:21,242 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-15 21:11:21,242 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemState faf012332edd8fd89b4f1b924a8cd490 2023-07-15 21:11:21,242 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,,1689455480845.faf012332edd8fd89b4f1b924a8cd490.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-15 21:11:21,242 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for faf012332edd8fd89b4f1b924a8cd490 2023-07-15 21:11:21,242 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for faf012332edd8fd89b4f1b924a8cd490 2023-07-15 21:11:21,244 INFO [StoreOpener-faf012332edd8fd89b4f1b924a8cd490-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region faf012332edd8fd89b4f1b924a8cd490 2023-07-15 21:11:21,245 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 1e1f50649aa7248f9da070059fc4ce7d 2023-07-15 21:11:21,245 DEBUG [StoreOpener-faf012332edd8fd89b4f1b924a8cd490-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/data/default/testtb-testExportFileSystemState/faf012332edd8fd89b4f1b924a8cd490/cf 2023-07-15 21:11:21,245 DEBUG [StoreOpener-faf012332edd8fd89b4f1b924a8cd490-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/data/default/testtb-testExportFileSystemState/faf012332edd8fd89b4f1b924a8cd490/cf 2023-07-15 21:11:21,246 INFO [StoreOpener-faf012332edd8fd89b4f1b924a8cd490-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region faf012332edd8fd89b4f1b924a8cd490 columnFamilyName cf 2023-07-15 21:11:21,247 INFO [StoreOpener-faf012332edd8fd89b4f1b924a8cd490-1] regionserver.HStore(310): Store=faf012332edd8fd89b4f1b924a8cd490/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-15 21:11:21,247 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/data/default/testtb-testExportFileSystemState/1e1f50649aa7248f9da070059fc4ce7d/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-15 21:11:21,249 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/data/default/testtb-testExportFileSystemState/faf012332edd8fd89b4f1b924a8cd490 2023-07-15 21:11:21,249 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 1e1f50649aa7248f9da070059fc4ce7d; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69809789, jitterRate=0.04024691879749298}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-15 21:11:21,250 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 1e1f50649aa7248f9da070059fc4ce7d: 2023-07-15 21:11:21,250 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/data/default/testtb-testExportFileSystemState/faf012332edd8fd89b4f1b924a8cd490 2023-07-15 21:11:21,251 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemState,1,1689455480845.1e1f50649aa7248f9da070059fc4ce7d., pid=30, masterSystemTime=1689455481221 2023-07-15 21:11:21,253 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemState,1,1689455480845.1e1f50649aa7248f9da070059fc4ce7d. 2023-07-15 21:11:21,253 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemState,1,1689455480845.1e1f50649aa7248f9da070059fc4ce7d. 2023-07-15 21:11:21,253 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for faf012332edd8fd89b4f1b924a8cd490 2023-07-15 21:11:21,254 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=1e1f50649aa7248f9da070059fc4ce7d, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,39075,1689455452043 2023-07-15 21:11:21,254 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemState,1,1689455480845.1e1f50649aa7248f9da070059fc4ce7d.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689455481254"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689455481254"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689455481254"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689455481254"}]},"ts":"1689455481254"} 2023-07-15 21:11:21,256 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/data/default/testtb-testExportFileSystemState/faf012332edd8fd89b4f1b924a8cd490/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-15 21:11:21,256 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened faf012332edd8fd89b4f1b924a8cd490; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74838477, jitterRate=0.11518020927906036}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-15 21:11:21,256 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for faf012332edd8fd89b4f1b924a8cd490: 2023-07-15 21:11:21,258 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemState,,1689455480845.faf012332edd8fd89b4f1b924a8cd490., pid=31, masterSystemTime=1689455481227 2023-07-15 21:11:21,263 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=30, resume processing ppid=29 2023-07-15 21:11:21,263 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemState,,1689455480845.faf012332edd8fd89b4f1b924a8cd490. 2023-07-15 21:11:21,267 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=30, ppid=29, state=SUCCESS; OpenRegionProcedure 1e1f50649aa7248f9da070059fc4ce7d, server=jenkins-hbase4.apache.org,39075,1689455452043 in 188 msec 2023-07-15 21:11:21,268 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemState,,1689455480845.faf012332edd8fd89b4f1b924a8cd490. 2023-07-15 21:11:21,268 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=faf012332edd8fd89b4f1b924a8cd490, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,37853,1689455451932 2023-07-15 21:11:21,269 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemState,,1689455480845.faf012332edd8fd89b4f1b924a8cd490.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689455481268"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689455481268"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689455481268"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689455481268"}]},"ts":"1689455481268"} 2023-07-15 21:11:21,270 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=29, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=1e1f50649aa7248f9da070059fc4ce7d, ASSIGN in 358 msec 2023-07-15 21:11:21,274 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=31, resume processing ppid=28 2023-07-15 21:11:21,274 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=31, ppid=28, state=SUCCESS; OpenRegionProcedure faf012332edd8fd89b4f1b924a8cd490, server=jenkins-hbase4.apache.org,37853,1689455451932 in 201 msec 2023-07-15 21:11:21,277 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=28, resume processing ppid=27 2023-07-15 21:11:21,278 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=28, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=faf012332edd8fd89b4f1b924a8cd490, ASSIGN in 365 msec 2023-07-15 21:11:21,278 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-15 21:11:21,278 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689455481278"}]},"ts":"1689455481278"} 2023-07-15 21:11:21,280 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=ENABLED in hbase:meta 2023-07-15 21:11:21,367 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_POST_OPERATION 2023-07-15 21:11:21,368 DEBUG [PEWorker-2] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemState jenkins: RWXCA 2023-07-15 21:11:21,370 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=39075] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-07-15 21:11:21,457 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36465] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-15 21:11:21,458 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): regionserver:37853-0x1016ad2d8bb0001, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 21:11:21,458 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): master:36465-0x1016ad2d8bb0000, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 21:11:21,458 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): regionserver:39075-0x1016ad2d8bb0003, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 21:11:21,458 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): regionserver:39587-0x1016ad2d8bb0002, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 21:11:21,558 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-15 21:11:21,558 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-15 21:11:21,558 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-15 21:11:21,558 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-15 21:11:21,561 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=27, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemState in 711 msec 2023-07-15 21:11:21,958 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36465] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-15 21:11:21,959 INFO [Listener at jenkins-hbase4.apache.org/41711] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemState, procId: 27 completed 2023-07-15 21:11:21,962 DEBUG [Listener at jenkins-hbase4.apache.org/41711] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemState 2023-07-15 21:11:21,962 DEBUG [Listener at jenkins-hbase4.apache.org/41711] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemState,,1689455480845.faf012332edd8fd89b4f1b924a8cd490. 2023-07-15 21:11:21,965 INFO [Listener at jenkins-hbase4.apache.org/41711] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-15 21:11:21,973 DEBUG [hconnection-0x15927c21-shared-pool-10] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-15 21:11:21,977 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:45582, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-15 21:11:21,982 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36465] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-15 21:11:21,982 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36465] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689455481982 (current time:1689455481982). 2023-07-15 21:11:21,983 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36465] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-15 21:11:21,983 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36465] zookeeper.ReadOnlyZKClient(139): Connect 0x2132ef8b to 127.0.0.1:50024 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-15 21:11:22,066 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36465] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@607223dc, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-15 21:11:22,068 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36465] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-15 21:11:22,069 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:51994, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-15 21:11:22,070 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36465] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2132ef8b to 127.0.0.1:50024 2023-07-15 21:11:22,071 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36465] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-15 21:11:22,071 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36465] zookeeper.ReadOnlyZKClient(139): Connect 0x1ab5f314 to 127.0.0.1:50024 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-15 21:11:22,197 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36465] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2ccd097e, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-15 21:11:22,199 DEBUG [hconnection-0x5dd0a3f8-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-15 21:11:22,203 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:52004, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-15 21:11:22,209 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36465] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1ab5f314 to 127.0.0.1:50024 2023-07-15 21:11:22,209 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36465] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-15 21:11:22,209 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36465] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-07-15 21:11:22,210 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36465] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-15 21:11:22,210 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36465] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-15 21:11:22,213 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36465] procedure2.ProcedureExecutor(1029): Stored pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-15 21:11:22,215 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-15 21:11:22,216 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=32, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1689456082216 2023-07-15 21:11:22,216 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState 2023-07-15 21:11:22,216 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36465] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-15 21:11:22,218 DEBUG [Listener at jenkins-hbase4.apache.org/41711] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-15 21:11:22,218 DEBUG [Listener at jenkins-hbase4.apache.org/41711] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-15 21:11:22,218 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=33, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-15 21:11:22,219 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=32, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-15 21:11:22,221 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=32, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE in 7 msec 2023-07-15 21:11:22,222 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=33, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-15 21:11:22,223 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=33, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED; timeout=600000, timestamp=1689456082223 2023-07-15 21:11:22,242 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemState 2023-07-15 21:11:22,242 INFO [(jenkins-hbase4.apache.org,36465,1689455450507)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemState' 2023-07-15 21:11:22,242 DEBUG [(jenkins-hbase4.apache.org,36465,1689455450507)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 21:11:22,244 DEBUG [(jenkins-hbase4.apache.org,36465,1689455450507)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' 2023-07-15 21:11:22,244 DEBUG [(jenkins-hbase4.apache.org,36465,1689455450507)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemState', kicking off acquire phase on members. 2023-07-15 21:11:22,281 DEBUG [(jenkins-hbase4.apache.org,36465,1689455450507)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36465-0x1016ad2d8bb0000, quorum=127.0.0.1:50024, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-15 21:11:22,281 DEBUG [(jenkins-hbase4.apache.org,36465,1689455450507)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-15 21:11:22,312 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): regionserver:39587-0x1016ad2d8bb0002, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 21:11:22,312 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): regionserver:37853-0x1016ad2d8bb0001, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 21:11:22,312 DEBUG [(jenkins-hbase4.apache.org,36465,1689455450507)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39075,1689455452043 2023-07-15 21:11:22,312 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 21:11:22,312 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): regionserver:39075-0x1016ad2d8bb0003, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 21:11:22,312 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 21:11:22,312 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 21:11:22,312 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 21:11:22,312 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 21:11:22,312 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 21:11:22,312 DEBUG [(jenkins-hbase4.apache.org,36465,1689455450507)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36465-0x1016ad2d8bb0000, quorum=127.0.0.1:50024, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39075,1689455452043 2023-07-15 21:11:22,312 DEBUG [(jenkins-hbase4.apache.org,36465,1689455450507)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37853,1689455451932 2023-07-15 21:11:22,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-15 21:11:22,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-15 21:11:22,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-15 21:11:22,315 DEBUG [(jenkins-hbase4.apache.org,36465,1689455450507)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36465-0x1016ad2d8bb0000, quorum=127.0.0.1:50024, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37853,1689455451932 2023-07-15 21:11:22,315 DEBUG [(jenkins-hbase4.apache.org,36465,1689455450507)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-15 21:11:22,315 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37853-0x1016ad2d8bb0001, quorum=127.0.0.1:50024, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-15 21:11:22,315 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39587-0x1016ad2d8bb0002, quorum=127.0.0.1:50024, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-15 21:11:22,315 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39075-0x1016ad2d8bb0003, quorum=127.0.0.1:50024, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-15 21:11:22,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-07-15 21:11:22,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-15 21:11:22,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-07-15 21:11:22,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-15 21:11:22,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-07-15 21:11:22,316 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-15 21:11:22,316 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-15 21:11:22,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-15 21:11:22,316 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-15 21:11:22,316 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-07-15 21:11:22,316 DEBUG [member: 'jenkins-hbase4.apache.org,39587,1689455451998' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-15 21:11:22,316 DEBUG [member: 'jenkins-hbase4.apache.org,39587,1689455451998' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 21:11:22,316 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-07-15 21:11:22,318 DEBUG [member: 'jenkins-hbase4.apache.org,39587,1689455451998' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-15 21:11:22,318 DEBUG [member: 'jenkins-hbase4.apache.org,37853,1689455451932' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-15 21:11:22,318 DEBUG [member: 'jenkins-hbase4.apache.org,39587,1689455451998' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-07-15 21:11:22,318 DEBUG [Listener at jenkins-hbase4.apache.org/41711] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-15 21:11:22,318 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-07-15 21:11:22,318 DEBUG [member: 'jenkins-hbase4.apache.org,39587,1689455451998' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39587,1689455451998' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-07-15 21:11:22,318 DEBUG [member: 'jenkins-hbase4.apache.org,37853,1689455451932' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 21:11:22,318 DEBUG [member: 'jenkins-hbase4.apache.org,39075,1689455452043' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-15 21:11:22,318 DEBUG [member: 'jenkins-hbase4.apache.org,39075,1689455452043' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 21:11:22,319 DEBUG [member: 'jenkins-hbase4.apache.org,37853,1689455451932' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-15 21:11:22,320 DEBUG [member: 'jenkins-hbase4.apache.org,37853,1689455451932' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-07-15 21:11:22,320 DEBUG [member: 'jenkins-hbase4.apache.org,37853,1689455451932' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37853,1689455451932' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-07-15 21:11:22,321 DEBUG [member: 'jenkins-hbase4.apache.org,39075,1689455452043' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-15 21:11:22,321 DEBUG [member: 'jenkins-hbase4.apache.org,39075,1689455452043' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-07-15 21:11:22,321 DEBUG [member: 'jenkins-hbase4.apache.org,39075,1689455452043' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39075,1689455452043' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-07-15 21:11:22,321 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36465] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-15 21:11:22,321 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36465] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-15 21:11:22,322 DEBUG [Listener at jenkins-hbase4.apache.org/41711] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-15 21:11:22,342 DEBUG [member: 'jenkins-hbase4.apache.org,39587,1689455451998' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-15 21:11:22,466 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): master:36465-0x1016ad2d8bb0000, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37853,1689455451932 2023-07-15 21:11:22,466 DEBUG [member: 'jenkins-hbase4.apache.org,37853,1689455451932' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-15 21:11:22,467 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37853,1689455451932 2023-07-15 21:11:22,467 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 21:11:22,467 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 21:11:22,522 DEBUG [Listener at jenkins-hbase4.apache.org/41711] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-15 21:11:22,523 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36465] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-15 21:11:22,523 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36465] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-15 21:11:22,523 DEBUG [Listener at jenkins-hbase4.apache.org/41711] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-15 21:11:22,535 DEBUG [member: 'jenkins-hbase4.apache.org,39075,1689455452043' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-15 21:11:22,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 21:11:22,535 DEBUG [member: 'jenkins-hbase4.apache.org,37853,1689455451932' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37853-0x1016ad2d8bb0001, quorum=127.0.0.1:50024, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-15 21:11:22,535 DEBUG [member: 'jenkins-hbase4.apache.org,37853,1689455451932' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-15 21:11:22,535 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): master:36465-0x1016ad2d8bb0000, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39075,1689455452043 2023-07-15 21:11:22,535 DEBUG [member: 'jenkins-hbase4.apache.org,39587,1689455451998' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39587-0x1016ad2d8bb0002, quorum=127.0.0.1:50024, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-15 21:11:22,535 DEBUG [member: 'jenkins-hbase4.apache.org,39587,1689455451998' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-15 21:11:22,535 DEBUG [member: 'jenkins-hbase4.apache.org,39075,1689455452043' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39075-0x1016ad2d8bb0003, quorum=127.0.0.1:50024, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-15 21:11:22,535 DEBUG [member: 'jenkins-hbase4.apache.org,39075,1689455452043' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-15 21:11:22,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 21:11:22,536 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-15 21:11:22,536 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39075,1689455452043 2023-07-15 21:11:22,536 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39587,1689455451998 2023-07-15 21:11:22,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37853,1689455451932 2023-07-15 21:11:22,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 21:11:22,537 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37853,1689455451932' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemState' on coordinator 2023-07-15 21:11:22,537 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1febcd11[Count = 1] remaining members to acquire global barrier 2023-07-15 21:11:22,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39075,1689455452043 2023-07-15 21:11:22,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 21:11:22,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 21:11:22,538 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 21:11:22,538 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 21:11:22,538 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-15 21:11:22,538 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39075,1689455452043 2023-07-15 21:11:22,539 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39587,1689455451998 2023-07-15 21:11:22,539 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37853,1689455451932 2023-07-15 21:11:22,539 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 21:11:22,540 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39075,1689455452043' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemState' on coordinator 2023-07-15 21:11:22,540 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1febcd11[Count = 0] remaining members to acquire global barrier 2023-07-15 21:11:22,540 DEBUG [(jenkins-hbase4.apache.org,36465,1689455450507)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemState' starting 'in-barrier' execution. 2023-07-15 21:11:22,540 DEBUG [(jenkins-hbase4.apache.org,36465,1689455450507)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-15 21:11:22,566 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): regionserver:39587-0x1016ad2d8bb0002, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-15 21:11:22,566 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): regionserver:37853-0x1016ad2d8bb0001, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-15 21:11:22,566 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): regionserver:39075-0x1016ad2d8bb0003, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-15 21:11:22,566 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-15 21:11:22,566 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-15 21:11:22,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-15 21:11:22,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-15 21:11:22,566 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-15 21:11:22,566 DEBUG [member: 'jenkins-hbase4.apache.org,37853,1689455451932' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-15 21:11:22,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-15 21:11:22,566 DEBUG [member: 'jenkins-hbase4.apache.org,39075,1689455452043' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-15 21:11:22,566 DEBUG [member: 'jenkins-hbase4.apache.org,39587,1689455451998' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-15 21:11:22,566 DEBUG [member: 'jenkins-hbase4.apache.org,39587,1689455451998' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-07-15 21:11:22,566 DEBUG [member: 'jenkins-hbase4.apache.org,39587,1689455451998' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,39587,1689455451998' in zk 2023-07-15 21:11:22,566 DEBUG [(jenkins-hbase4.apache.org,36465,1689455450507)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36465-0x1016ad2d8bb0000, quorum=127.0.0.1:50024, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37853,1689455451932 2023-07-15 21:11:22,566 DEBUG [member: 'jenkins-hbase4.apache.org,37853,1689455451932' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-15 21:11:22,566 DEBUG [member: 'jenkins-hbase4.apache.org,39075,1689455452043' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-15 21:11:22,566 DEBUG [member: 'jenkins-hbase4.apache.org,39075,1689455452043' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-15 21:11:22,566 DEBUG [member: 'jenkins-hbase4.apache.org,37853,1689455451932' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-15 21:11:22,566 DEBUG [rs(jenkins-hbase4.apache.org,37853,1689455451932)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,,1689455480845.faf012332edd8fd89b4f1b924a8cd490. 2023-07-15 21:11:22,567 DEBUG [rs(jenkins-hbase4.apache.org,39075,1689455452043)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,1,1689455480845.1e1f50649aa7248f9da070059fc4ce7d. 2023-07-15 21:11:22,567 DEBUG [rs(jenkins-hbase4.apache.org,37853,1689455451932)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,,1689455480845.faf012332edd8fd89b4f1b924a8cd490. started... 2023-07-15 21:11:22,567 DEBUG [rs(jenkins-hbase4.apache.org,39075,1689455452043)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,1,1689455480845.1e1f50649aa7248f9da070059fc4ce7d. started... 2023-07-15 21:11:22,567 DEBUG [(jenkins-hbase4.apache.org,36465,1689455450507)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36465-0x1016ad2d8bb0000, quorum=127.0.0.1:50024, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39075,1689455452043 2023-07-15 21:11:22,567 DEBUG [(jenkins-hbase4.apache.org,36465,1689455450507)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-15 21:11:22,567 DEBUG [rs(jenkins-hbase4.apache.org,37853,1689455451932)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for faf012332edd8fd89b4f1b924a8cd490: 2023-07-15 21:11:22,568 DEBUG [rs(jenkins-hbase4.apache.org,39075,1689455452043)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 1e1f50649aa7248f9da070059fc4ce7d: 2023-07-15 21:11:22,569 DEBUG [rs(jenkins-hbase4.apache.org,37853,1689455451932)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,,1689455480845.faf012332edd8fd89b4f1b924a8cd490.' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-07-15 21:11:22,569 DEBUG [rs(jenkins-hbase4.apache.org,39075,1689455452043)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,1,1689455480845.1e1f50649aa7248f9da070059fc4ce7d.' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-07-15 21:11:22,569 DEBUG [rs(jenkins-hbase4.apache.org,37853,1689455451932)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-15 21:11:22,569 DEBUG [rs(jenkins-hbase4.apache.org,39075,1689455452043)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-15 21:11:22,569 DEBUG [rs(jenkins-hbase4.apache.org,37853,1689455451932)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-15 21:11:22,569 DEBUG [rs(jenkins-hbase4.apache.org,39075,1689455452043)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-15 21:11:22,585 DEBUG [rs(jenkins-hbase4.apache.org,39075,1689455452043)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,1,1689455480845.1e1f50649aa7248f9da070059fc4ce7d. completed. 2023-07-15 21:11:22,585 DEBUG [rs(jenkins-hbase4.apache.org,39075,1689455452043)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,1,1689455480845.1e1f50649aa7248f9da070059fc4ce7d. 2023-07-15 21:11:22,586 DEBUG [member: 'jenkins-hbase4.apache.org,39075,1689455452043' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-15 21:11:22,586 DEBUG [member: 'jenkins-hbase4.apache.org,39075,1689455452043' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-15 21:11:22,586 DEBUG [member: 'jenkins-hbase4.apache.org,39075,1689455452043' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,39075,1689455452043 2023-07-15 21:11:22,586 DEBUG [member: 'jenkins-hbase4.apache.org,39075,1689455452043' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-07-15 21:11:22,586 DEBUG [member: 'jenkins-hbase4.apache.org,39075,1689455452043' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,39075,1689455452043' in zk 2023-07-15 21:11:22,612 DEBUG [member: 'jenkins-hbase4.apache.org,39587,1689455451998' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-07-15 21:11:22,612 DEBUG [member: 'jenkins-hbase4.apache.org,39587,1689455451998' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 21:11:22,612 DEBUG [member: 'jenkins-hbase4.apache.org,39587,1689455451998' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-07-15 21:11:22,658 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): master:36465-0x1016ad2d8bb0000, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39075,1689455452043 2023-07-15 21:11:22,658 DEBUG [member: 'jenkins-hbase4.apache.org,39075,1689455452043' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-07-15 21:11:22,658 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39075,1689455452043 2023-07-15 21:11:22,658 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 21:11:22,658 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 21:11:22,658 DEBUG [member: 'jenkins-hbase4.apache.org,39075,1689455452043' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 21:11:22,658 DEBUG [member: 'jenkins-hbase4.apache.org,39075,1689455452043' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-07-15 21:11:22,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 21:11:22,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 21:11:22,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-15 21:11:22,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39075,1689455452043 2023-07-15 21:11:22,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39587,1689455451998 2023-07-15 21:11:22,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37853,1689455451932 2023-07-15 21:11:22,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 21:11:22,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-15 21:11:22,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39075,1689455452043 2023-07-15 21:11:22,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39587,1689455451998 2023-07-15 21:11:22,664 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,39075,1689455452043': 2023-07-15 21:11:22,664 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39075,1689455452043' released barrier for procedure'emptySnaptb0-testExportFileSystemState', counting down latch. Waiting for 1 more 2023-07-15 21:11:22,823 DEBUG [Listener at jenkins-hbase4.apache.org/41711] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-15 21:11:22,824 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36465] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-15 21:11:22,824 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36465] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-15 21:11:22,825 DEBUG [Listener at jenkins-hbase4.apache.org/41711] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-07-15 21:11:22,986 DEBUG [rs(jenkins-hbase4.apache.org,37853,1689455451932)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,,1689455480845.faf012332edd8fd89b4f1b924a8cd490. completed. 2023-07-15 21:11:22,986 DEBUG [rs(jenkins-hbase4.apache.org,37853,1689455451932)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,,1689455480845.faf012332edd8fd89b4f1b924a8cd490. 2023-07-15 21:11:22,986 DEBUG [member: 'jenkins-hbase4.apache.org,37853,1689455451932' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-15 21:11:22,986 DEBUG [member: 'jenkins-hbase4.apache.org,37853,1689455451932' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-15 21:11:22,986 DEBUG [member: 'jenkins-hbase4.apache.org,37853,1689455451932' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,37853,1689455451932 2023-07-15 21:11:22,986 DEBUG [member: 'jenkins-hbase4.apache.org,37853,1689455451932' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-07-15 21:11:22,986 DEBUG [member: 'jenkins-hbase4.apache.org,37853,1689455451932' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,37853,1689455451932' in zk 2023-07-15 21:11:23,027 DEBUG [member: 'jenkins-hbase4.apache.org,37853,1689455451932' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-07-15 21:11:23,027 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): master:36465-0x1016ad2d8bb0000, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37853,1689455451932 2023-07-15 21:11:23,027 DEBUG [member: 'jenkins-hbase4.apache.org,37853,1689455451932' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 21:11:23,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37853,1689455451932 2023-07-15 21:11:23,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 21:11:23,027 DEBUG [member: 'jenkins-hbase4.apache.org,37853,1689455451932' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-07-15 21:11:23,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 21:11:23,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 21:11:23,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 21:11:23,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-15 21:11:23,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39075,1689455452043 2023-07-15 21:11:23,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39587,1689455451998 2023-07-15 21:11:23,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37853,1689455451932 2023-07-15 21:11:23,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 21:11:23,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-15 21:11:23,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39075,1689455452043 2023-07-15 21:11:23,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39587,1689455451998 2023-07-15 21:11:23,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37853,1689455451932 2023-07-15 21:11:23,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,37853,1689455451932': 2023-07-15 21:11:23,033 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37853,1689455451932' released barrier for procedure'emptySnaptb0-testExportFileSystemState', counting down latch. Waiting for 0 more 2023-07-15 21:11:23,033 INFO [(jenkins-hbase4.apache.org,36465,1689455450507)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemState' execution completed 2023-07-15 21:11:23,033 DEBUG [(jenkins-hbase4.apache.org,36465,1689455450507)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-15 21:11:23,033 DEBUG [(jenkins-hbase4.apache.org,36465,1689455450507)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-15 21:11:23,033 DEBUG [(jenkins-hbase4.apache.org,36465,1689455450507)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemState 2023-07-15 21:11:23,033 INFO [(jenkins-hbase4.apache.org,36465,1689455450507)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-15 21:11:23,058 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): regionserver:39075-0x1016ad2d8bb0003, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-15 21:11:23,058 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): regionserver:37853-0x1016ad2d8bb0001, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-15 21:11:23,058 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-15 21:11:23,058 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-15 21:11:23,058 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): master:36465-0x1016ad2d8bb0000, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-15 21:11:23,058 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): regionserver:37853-0x1016ad2d8bb0001, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 21:11:23,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-15 21:11:23,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 21:11:23,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 21:11:23,058 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): regionserver:39587-0x1016ad2d8bb0002, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-15 21:11:23,058 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): regionserver:39075-0x1016ad2d8bb0003, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 21:11:23,059 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-15 21:11:23,059 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): regionserver:39587-0x1016ad2d8bb0002, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 21:11:23,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-15 21:11:23,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-15 21:11:23,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-15 21:11:23,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 21:11:23,059 DEBUG [(jenkins-hbase4.apache.org,36465,1689455450507)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36465-0x1016ad2d8bb0000, quorum=127.0.0.1:50024, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39075,1689455452043 2023-07-15 21:11:23,059 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 21:11:23,059 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 21:11:23,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 21:11:23,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 21:11:23,059 DEBUG [(jenkins-hbase4.apache.org,36465,1689455450507)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36465-0x1016ad2d8bb0000, quorum=127.0.0.1:50024, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39587,1689455451998 2023-07-15 21:11:23,059 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 21:11:23,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 21:11:23,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-15 21:11:23,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-15 21:11:23,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-15 21:11:23,060 DEBUG [(jenkins-hbase4.apache.org,36465,1689455450507)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36465-0x1016ad2d8bb0000, quorum=127.0.0.1:50024, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37853,1689455451932 2023-07-15 21:11:23,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-15 21:11:23,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 21:11:23,061 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-15 21:11:23,061 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39075,1689455452043 2023-07-15 21:11:23,061 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39587,1689455451998 2023-07-15 21:11:23,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37853,1689455451932 2023-07-15 21:11:23,062 DEBUG [(jenkins-hbase4.apache.org,36465,1689455450507)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36465-0x1016ad2d8bb0000, quorum=127.0.0.1:50024, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39075,1689455452043 2023-07-15 21:11:23,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 21:11:23,062 DEBUG [(jenkins-hbase4.apache.org,36465,1689455450507)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36465-0x1016ad2d8bb0000, quorum=127.0.0.1:50024, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39587,1689455451998 2023-07-15 21:11:23,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-15 21:11:23,062 DEBUG [(jenkins-hbase4.apache.org,36465,1689455450507)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36465-0x1016ad2d8bb0000, quorum=127.0.0.1:50024, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37853,1689455451932 2023-07-15 21:11:23,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39075,1689455452043 2023-07-15 21:11:23,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39587,1689455451998 2023-07-15 21:11:23,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37853,1689455451932 2023-07-15 21:11:23,081 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): master:36465-0x1016ad2d8bb0000, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37853,1689455451932 2023-07-15 21:11:23,081 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): regionserver:39075-0x1016ad2d8bb0003, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 21:11:23,081 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): regionserver:37853-0x1016ad2d8bb0001, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 21:11:23,081 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 21:11:23,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 21:11:23,081 DEBUG [(jenkins-hbase4.apache.org,36465,1689455450507)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 21:11:23,081 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 21:11:23,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 21:11:23,081 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): regionserver:39075-0x1016ad2d8bb0003, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 21:11:23,081 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): master:36465-0x1016ad2d8bb0000, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-15 21:11:23,081 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): regionserver:39587-0x1016ad2d8bb0002, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 21:11:23,082 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): master:36465-0x1016ad2d8bb0000, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39587,1689455451998 2023-07-15 21:11:23,082 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 21:11:23,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 21:11:23,081 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemState 2023-07-15 21:11:23,081 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): regionserver:37853-0x1016ad2d8bb0001, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 21:11:23,082 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemState 2023-07-15 21:11:23,082 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 21:11:23,082 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): master:36465-0x1016ad2d8bb0000, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39075,1689455452043 2023-07-15 21:11:23,083 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 8c2558c0b59bb3a4e2e578c2c8e8915d, NAME => 'testtb-testExportFileSystemState,.mob,0.8c2558c0b59bb3a4e2e578c2c8e8915d.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-07-15 21:11:23,082 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 21:11:23,082 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): regionserver:39587-0x1016ad2d8bb0002, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 21:11:23,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 21:11:23,083 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 21:11:23,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 21:11:23,083 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-15 21:11:23,083 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): master:36465-0x1016ad2d8bb0000, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-15 21:11:23,083 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): master:36465-0x1016ad2d8bb0000, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37853,1689455451932 2023-07-15 21:11:23,083 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): master:36465-0x1016ad2d8bb0000, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-15 21:11:23,083 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): master:36465-0x1016ad2d8bb0000, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39587,1689455451998 2023-07-15 21:11:23,083 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): master:36465-0x1016ad2d8bb0000, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39075,1689455452043 2023-07-15 21:11:23,083 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): master:36465-0x1016ad2d8bb0000, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-15 21:11:23,083 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): master:36465-0x1016ad2d8bb0000, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-15 21:11:23,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 21:11:23,084 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-07-15 21:11:23,095 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemState 2023-07-15 21:11:23,095 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-07-15 21:11:23,116 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState to hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/.hbase-snapshot/emptySnaptb0-testExportFileSystemState 2023-07-15 21:11:23,154 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed 2023-07-15 21:11:23,154 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-07-15 21:11:23,155 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-07-15 21:11:23,155 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState at 1689455482216Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemState at 1689455483095 (+879 ms)Consolidate snapshot: emptySnaptb0-testExportFileSystemState at 1689455483095Loading Region manifests for emptySnaptb0-testExportFileSystemState at 1689455483095Writing data manifest for emptySnaptb0-testExportFileSystemState at 1689455483099 (+4 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemState at 1689455483110 (+11 ms)Snapshot emptySnaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed at 1689455483154 (+44 ms) 2023-07-15 21:11:23,157 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=33, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-15 21:11:23,159 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=33, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED in 940 msec 2023-07-15 21:11:23,325 DEBUG [Listener at jenkins-hbase4.apache.org/41711] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-15 21:11:23,326 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36465] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-15 21:11:23,326 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36465] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-15 21:11:23,330 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37853] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemState,,1689455480845.faf012332edd8fd89b4f1b924a8cd490. with WAL disabled. Data may be lost in the event of a crash. 2023-07-15 21:11:23,332 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39075] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemState,1,1689455480845.1e1f50649aa7248f9da070059fc4ce7d. with WAL disabled. Data may be lost in the event of a crash. 2023-07-15 21:11:23,337 DEBUG [Listener at jenkins-hbase4.apache.org/41711] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemState 2023-07-15 21:11:23,337 DEBUG [Listener at jenkins-hbase4.apache.org/41711] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemState,,1689455480845.faf012332edd8fd89b4f1b924a8cd490. 2023-07-15 21:11:23,337 INFO [Listener at jenkins-hbase4.apache.org/41711] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-15 21:11:23,349 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36465] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-15 21:11:23,349 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36465] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689455483349 (current time:1689455483349). 2023-07-15 21:11:23,349 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36465] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-15 21:11:23,350 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36465] zookeeper.ReadOnlyZKClient(139): Connect 0x48306000 to 127.0.0.1:50024 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-15 21:11:23,397 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36465] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@478df243, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-15 21:11:23,399 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36465] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-15 21:11:23,403 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:52008, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-15 21:11:23,405 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36465] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x48306000 to 127.0.0.1:50024 2023-07-15 21:11:23,405 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36465] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-15 21:11:23,406 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36465] zookeeper.ReadOnlyZKClient(139): Connect 0x1030badd to 127.0.0.1:50024 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-15 21:11:23,421 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36465] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@737c066b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-15 21:11:23,424 DEBUG [hconnection-0x27203089-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-15 21:11:23,425 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:52016, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-15 21:11:23,432 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36465] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1030badd to 127.0.0.1:50024 2023-07-15 21:11:23,433 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36465] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-15 21:11:23,433 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36465] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-07-15 21:11:23,434 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36465] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-15 21:11:23,434 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36465] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-15 21:11:23,439 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36465] procedure2.ProcedureExecutor(1029): Stored pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-15 21:11:23,440 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-15 21:11:23,441 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=34, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1689456083441 2023-07-15 21:11:23,441 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36465] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-15 21:11:23,441 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState 2023-07-15 21:11:23,443 DEBUG [Listener at jenkins-hbase4.apache.org/41711] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-15 21:11:23,443 DEBUG [Listener at jenkins-hbase4.apache.org/41711] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-15 21:11:23,444 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=35, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-15 21:11:23,445 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=34, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-15 21:11:23,453 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=34, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE in 15 msec 2023-07-15 21:11:23,454 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=35, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-15 21:11:23,458 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=35, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED; timeout=600000, timestamp=1689456083458 2023-07-15 21:11:23,472 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemState 2023-07-15 21:11:23,472 INFO [(jenkins-hbase4.apache.org,36465,1689455450507)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemState' 2023-07-15 21:11:23,472 DEBUG [(jenkins-hbase4.apache.org,36465,1689455450507)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 21:11:23,473 DEBUG [(jenkins-hbase4.apache.org,36465,1689455450507)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemState' starting 'acquire' 2023-07-15 21:11:23,473 DEBUG [(jenkins-hbase4.apache.org,36465,1689455450507)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemState', kicking off acquire phase on members. 2023-07-15 21:11:23,537 DEBUG [(jenkins-hbase4.apache.org,36465,1689455450507)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36465-0x1016ad2d8bb0000, quorum=127.0.0.1:50024, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-15 21:11:23,537 DEBUG [(jenkins-hbase4.apache.org,36465,1689455450507)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-15 21:11:23,539 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): regionserver:39075-0x1016ad2d8bb0003, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 21:11:23,539 DEBUG [(jenkins-hbase4.apache.org,36465,1689455450507)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39075,1689455452043 2023-07-15 21:11:23,539 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 21:11:23,539 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): regionserver:37853-0x1016ad2d8bb0001, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 21:11:23,539 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): regionserver:39587-0x1016ad2d8bb0002, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 21:11:23,539 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 21:11:23,539 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 21:11:23,539 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 21:11:23,540 DEBUG [(jenkins-hbase4.apache.org,36465,1689455450507)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36465-0x1016ad2d8bb0000, quorum=127.0.0.1:50024, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39075,1689455452043 2023-07-15 21:11:23,540 DEBUG [(jenkins-hbase4.apache.org,36465,1689455450507)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37853,1689455451932 2023-07-15 21:11:23,539 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 21:11:23,540 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 21:11:23,540 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-15 21:11:23,540 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-15 21:11:23,540 DEBUG [(jenkins-hbase4.apache.org,36465,1689455450507)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36465-0x1016ad2d8bb0000, quorum=127.0.0.1:50024, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37853,1689455451932 2023-07-15 21:11:23,540 DEBUG [(jenkins-hbase4.apache.org,36465,1689455450507)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-15 21:11:23,540 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-15 21:11:23,540 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39075-0x1016ad2d8bb0003, quorum=127.0.0.1:50024, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-15 21:11:23,540 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37853-0x1016ad2d8bb0001, quorum=127.0.0.1:50024, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-15 21:11:23,541 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39587-0x1016ad2d8bb0002, quorum=127.0.0.1:50024, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-15 21:11:23,541 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-07-15 21:11:23,541 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-07-15 21:11:23,541 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-15 21:11:23,541 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-15 21:11:23,541 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-07-15 21:11:23,541 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-15 21:11:23,541 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-15 21:11:23,541 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-15 21:11:23,541 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-15 21:11:23,541 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-07-15 21:11:23,541 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-07-15 21:11:23,541 DEBUG [member: 'jenkins-hbase4.apache.org,39075,1689455452043' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-15 21:11:23,541 DEBUG [member: 'jenkins-hbase4.apache.org,37853,1689455451932' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-15 21:11:23,541 DEBUG [member: 'jenkins-hbase4.apache.org,37853,1689455451932' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 21:11:23,541 DEBUG [member: 'jenkins-hbase4.apache.org,39075,1689455452043' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 21:11:23,543 DEBUG [member: 'jenkins-hbase4.apache.org,37853,1689455451932' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-15 21:11:23,544 DEBUG [member: 'jenkins-hbase4.apache.org,39075,1689455452043' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-15 21:11:23,544 DEBUG [member: 'jenkins-hbase4.apache.org,39075,1689455452043' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-07-15 21:11:23,544 DEBUG [member: 'jenkins-hbase4.apache.org,39075,1689455452043' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39075,1689455452043' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-07-15 21:11:23,541 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-07-15 21:11:23,544 DEBUG [member: 'jenkins-hbase4.apache.org,37853,1689455451932' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-07-15 21:11:23,544 DEBUG [member: 'jenkins-hbase4.apache.org,39587,1689455451998' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-15 21:11:23,544 DEBUG [Listener at jenkins-hbase4.apache.org/41711] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-15 21:11:23,544 DEBUG [member: 'jenkins-hbase4.apache.org,39587,1689455451998' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 21:11:23,544 DEBUG [member: 'jenkins-hbase4.apache.org,37853,1689455451932' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37853,1689455451932' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-07-15 21:11:23,545 DEBUG [member: 'jenkins-hbase4.apache.org,39587,1689455451998' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-15 21:11:23,545 DEBUG [member: 'jenkins-hbase4.apache.org,39587,1689455451998' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-07-15 21:11:23,546 DEBUG [member: 'jenkins-hbase4.apache.org,39587,1689455451998' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39587,1689455451998' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-07-15 21:11:23,546 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36465] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-15 21:11:23,546 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36465] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-15 21:11:23,546 DEBUG [Listener at jenkins-hbase4.apache.org/41711] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-15 21:11:23,547 DEBUG [member: 'jenkins-hbase4.apache.org,39075,1689455452043' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-15 21:11:23,547 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): master:36465-0x1016ad2d8bb0000, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39075,1689455452043 2023-07-15 21:11:23,547 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39075,1689455452043 2023-07-15 21:11:23,547 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 21:11:23,547 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 21:11:23,548 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): master:36465-0x1016ad2d8bb0000, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37853,1689455451932 2023-07-15 21:11:23,548 DEBUG [member: 'jenkins-hbase4.apache.org,37853,1689455451932' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-15 21:11:23,549 DEBUG [member: 'jenkins-hbase4.apache.org,39587,1689455451998' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-15 21:11:23,549 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 21:11:23,549 DEBUG [member: 'jenkins-hbase4.apache.org,39075,1689455452043' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39075-0x1016ad2d8bb0003, quorum=127.0.0.1:50024, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-15 21:11:23,549 DEBUG [member: 'jenkins-hbase4.apache.org,39075,1689455452043' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-15 21:11:23,549 DEBUG [member: 'jenkins-hbase4.apache.org,37853,1689455451932' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37853-0x1016ad2d8bb0001, quorum=127.0.0.1:50024, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-15 21:11:23,549 DEBUG [member: 'jenkins-hbase4.apache.org,37853,1689455451932' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-15 21:11:23,549 DEBUG [member: 'jenkins-hbase4.apache.org,39587,1689455451998' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39587-0x1016ad2d8bb0002, quorum=127.0.0.1:50024, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-15 21:11:23,549 DEBUG [member: 'jenkins-hbase4.apache.org,39587,1689455451998' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-15 21:11:23,549 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 21:11:23,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-15 21:11:23,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39075,1689455452043 2023-07-15 21:11:23,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39587,1689455451998 2023-07-15 21:11:23,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37853,1689455451932 2023-07-15 21:11:23,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 21:11:23,552 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39075,1689455452043' joining acquired barrier for procedure 'snaptb0-testExportFileSystemState' on coordinator 2023-07-15 21:11:23,552 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@9807799[Count = 1] remaining members to acquire global barrier 2023-07-15 21:11:23,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37853,1689455451932 2023-07-15 21:11:23,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 21:11:23,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 21:11:23,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 21:11:23,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 21:11:23,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-15 21:11:23,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39075,1689455452043 2023-07-15 21:11:23,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39587,1689455451998 2023-07-15 21:11:23,554 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37853,1689455451932 2023-07-15 21:11:23,554 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 21:11:23,555 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37853,1689455451932' joining acquired barrier for procedure 'snaptb0-testExportFileSystemState' on coordinator 2023-07-15 21:11:23,555 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@9807799[Count = 0] remaining members to acquire global barrier 2023-07-15 21:11:23,555 DEBUG [(jenkins-hbase4.apache.org,36465,1689455450507)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemState' starting 'in-barrier' execution. 2023-07-15 21:11:23,555 DEBUG [(jenkins-hbase4.apache.org,36465,1689455450507)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-15 21:11:23,558 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): regionserver:39587-0x1016ad2d8bb0002, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-15 21:11:23,558 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): regionserver:37853-0x1016ad2d8bb0001, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-15 21:11:23,558 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-15 21:11:23,558 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): regionserver:39075-0x1016ad2d8bb0003, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-15 21:11:23,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-15 21:11:23,558 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-15 21:11:23,558 DEBUG [member: 'jenkins-hbase4.apache.org,39587,1689455451998' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-15 21:11:23,558 DEBUG [member: 'jenkins-hbase4.apache.org,39587,1689455451998' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-07-15 21:11:23,558 DEBUG [member: 'jenkins-hbase4.apache.org,39587,1689455451998' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,39587,1689455451998' in zk 2023-07-15 21:11:23,558 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-15 21:11:23,558 DEBUG [(jenkins-hbase4.apache.org,36465,1689455450507)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36465-0x1016ad2d8bb0000, quorum=127.0.0.1:50024, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39075,1689455452043 2023-07-15 21:11:23,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-15 21:11:23,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-15 21:11:23,559 DEBUG [member: 'jenkins-hbase4.apache.org,37853,1689455451932' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-15 21:11:23,559 DEBUG [member: 'jenkins-hbase4.apache.org,39075,1689455452043' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-15 21:11:23,559 DEBUG [member: 'jenkins-hbase4.apache.org,37853,1689455451932' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-15 21:11:23,559 DEBUG [member: 'jenkins-hbase4.apache.org,37853,1689455451932' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-15 21:11:23,559 DEBUG [member: 'jenkins-hbase4.apache.org,39075,1689455452043' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-15 21:11:23,559 DEBUG [member: 'jenkins-hbase4.apache.org,39075,1689455452043' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-15 21:11:23,559 DEBUG [rs(jenkins-hbase4.apache.org,39075,1689455452043)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,1,1689455480845.1e1f50649aa7248f9da070059fc4ce7d. 2023-07-15 21:11:23,559 DEBUG [(jenkins-hbase4.apache.org,36465,1689455450507)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36465-0x1016ad2d8bb0000, quorum=127.0.0.1:50024, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37853,1689455451932 2023-07-15 21:11:23,559 DEBUG [rs(jenkins-hbase4.apache.org,39075,1689455452043)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,1,1689455480845.1e1f50649aa7248f9da070059fc4ce7d. started... 2023-07-15 21:11:23,559 DEBUG [rs(jenkins-hbase4.apache.org,37853,1689455451932)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,,1689455480845.faf012332edd8fd89b4f1b924a8cd490. 2023-07-15 21:11:23,559 DEBUG [(jenkins-hbase4.apache.org,36465,1689455450507)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-15 21:11:23,559 DEBUG [rs(jenkins-hbase4.apache.org,37853,1689455451932)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,,1689455480845.faf012332edd8fd89b4f1b924a8cd490. started... 2023-07-15 21:11:23,560 INFO [rs(jenkins-hbase4.apache.org,39075,1689455452043)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 1e1f50649aa7248f9da070059fc4ce7d 1/1 column families, dataSize=3.06 KB heapSize=6.86 KB 2023-07-15 21:11:23,560 INFO [rs(jenkins-hbase4.apache.org,37853,1689455451932)-snapshot-pool-0] regionserver.HRegion(2745): Flushing faf012332edd8fd89b4f1b924a8cd490 1/1 column families, dataSize=199 B heapSize=688 B 2023-07-15 21:11:23,561 DEBUG [member: 'jenkins-hbase4.apache.org,39587,1689455451998' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-07-15 21:11:23,561 DEBUG [member: 'jenkins-hbase4.apache.org,39587,1689455451998' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 21:11:23,561 DEBUG [member: 'jenkins-hbase4.apache.org,39587,1689455451998' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-07-15 21:11:23,596 INFO [rs(jenkins-hbase4.apache.org,37853,1689455451932)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230715f8b83d206ff44968a964f5a275e78ce1 to hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e20230715f8b83d206ff44968a964f5a275e78ce1 2023-07-15 21:11:23,600 INFO [rs(jenkins-hbase4.apache.org,39075,1689455452043)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230715c28ece4e3c3148cca34d854b4aa80365 to hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b20230715c28ece4e3c3148cca34d854b4aa80365 2023-07-15 21:11:23,623 INFO [rs(jenkins-hbase4.apache.org,37853,1689455451932)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=199, hasBloomFilter=true, into tmp file hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/data/default/testtb-testExportFileSystemState/faf012332edd8fd89b4f1b924a8cd490/.tmp/cf/a5cbb1d72a5d4b28af3ebff15ef190ae 2023-07-15 21:11:23,624 INFO [rs(jenkins-hbase4.apache.org,39075,1689455452043)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/data/default/testtb-testExportFileSystemState/1e1f50649aa7248f9da070059fc4ce7d/.tmp/cf/30e5a9b9b62d48e2a35d9bb89ff867df 2023-07-15 21:11:23,638 DEBUG [rs(jenkins-hbase4.apache.org,37853,1689455451932)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/data/default/testtb-testExportFileSystemState/faf012332edd8fd89b4f1b924a8cd490/.tmp/cf/a5cbb1d72a5d4b28af3ebff15ef190ae as hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/data/default/testtb-testExportFileSystemState/faf012332edd8fd89b4f1b924a8cd490/cf/a5cbb1d72a5d4b28af3ebff15ef190ae 2023-07-15 21:11:23,642 DEBUG [rs(jenkins-hbase4.apache.org,39075,1689455452043)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/data/default/testtb-testExportFileSystemState/1e1f50649aa7248f9da070059fc4ce7d/.tmp/cf/30e5a9b9b62d48e2a35d9bb89ff867df as hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/data/default/testtb-testExportFileSystemState/1e1f50649aa7248f9da070059fc4ce7d/cf/30e5a9b9b62d48e2a35d9bb89ff867df 2023-07-15 21:11:23,646 INFO [rs(jenkins-hbase4.apache.org,37853,1689455451932)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/data/default/testtb-testExportFileSystemState/faf012332edd8fd89b4f1b924a8cd490/cf/a5cbb1d72a5d4b28af3ebff15ef190ae, entries=3, sequenceid=6, filesize=5.4 K 2023-07-15 21:11:23,656 INFO [rs(jenkins-hbase4.apache.org,39075,1689455452043)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/data/default/testtb-testExportFileSystemState/1e1f50649aa7248f9da070059fc4ce7d/cf/30e5a9b9b62d48e2a35d9bb89ff867df, entries=47, sequenceid=6, filesize=12.8 K 2023-07-15 21:11:23,657 INFO [rs(jenkins-hbase4.apache.org,37853,1689455451932)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~199 B/199, heapSize ~672 B/672, currentSize=0 B/0 for faf012332edd8fd89b4f1b924a8cd490 in 97ms, sequenceid=6, compaction requested=false 2023-07-15 21:11:23,657 DEBUG [rs(jenkins-hbase4.apache.org,37853,1689455451932)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemState' 2023-07-15 21:11:23,657 INFO [rs(jenkins-hbase4.apache.org,39075,1689455452043)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.06 KB/3137, heapSize ~6.84 KB/7008, currentSize=0 B/0 for 1e1f50649aa7248f9da070059fc4ce7d in 98ms, sequenceid=6, compaction requested=false 2023-07-15 21:11:23,657 DEBUG [rs(jenkins-hbase4.apache.org,39075,1689455452043)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemState' 2023-07-15 21:11:23,664 DEBUG [rs(jenkins-hbase4.apache.org,37853,1689455451932)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for faf012332edd8fd89b4f1b924a8cd490: 2023-07-15 21:11:23,664 DEBUG [rs(jenkins-hbase4.apache.org,39075,1689455452043)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 1e1f50649aa7248f9da070059fc4ce7d: 2023-07-15 21:11:23,664 DEBUG [rs(jenkins-hbase4.apache.org,39075,1689455452043)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,1,1689455480845.1e1f50649aa7248f9da070059fc4ce7d.' region-info for snapshot=snaptb0-testExportFileSystemState 2023-07-15 21:11:23,664 DEBUG [rs(jenkins-hbase4.apache.org,37853,1689455451932)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,,1689455480845.faf012332edd8fd89b4f1b924a8cd490.' region-info for snapshot=snaptb0-testExportFileSystemState 2023-07-15 21:11:23,664 DEBUG [rs(jenkins-hbase4.apache.org,39075,1689455452043)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-15 21:11:23,664 DEBUG [rs(jenkins-hbase4.apache.org,37853,1689455451932)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-15 21:11:23,664 DEBUG [rs(jenkins-hbase4.apache.org,39075,1689455452043)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/data/default/testtb-testExportFileSystemState/1e1f50649aa7248f9da070059fc4ce7d/cf/30e5a9b9b62d48e2a35d9bb89ff867df] hfiles 2023-07-15 21:11:23,664 DEBUG [rs(jenkins-hbase4.apache.org,37853,1689455451932)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/data/default/testtb-testExportFileSystemState/faf012332edd8fd89b4f1b924a8cd490/cf/a5cbb1d72a5d4b28af3ebff15ef190ae] hfiles 2023-07-15 21:11:23,664 DEBUG [rs(jenkins-hbase4.apache.org,39075,1689455452043)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/data/default/testtb-testExportFileSystemState/1e1f50649aa7248f9da070059fc4ce7d/cf/30e5a9b9b62d48e2a35d9bb89ff867df for snapshot=snaptb0-testExportFileSystemState 2023-07-15 21:11:23,665 DEBUG [rs(jenkins-hbase4.apache.org,37853,1689455451932)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/data/default/testtb-testExportFileSystemState/faf012332edd8fd89b4f1b924a8cd490/cf/a5cbb1d72a5d4b28af3ebff15ef190ae for snapshot=snaptb0-testExportFileSystemState 2023-07-15 21:11:23,735 DEBUG [rs(jenkins-hbase4.apache.org,37853,1689455451932)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,,1689455480845.faf012332edd8fd89b4f1b924a8cd490. completed. 2023-07-15 21:11:23,735 DEBUG [rs(jenkins-hbase4.apache.org,37853,1689455451932)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,,1689455480845.faf012332edd8fd89b4f1b924a8cd490. 2023-07-15 21:11:23,735 DEBUG [member: 'jenkins-hbase4.apache.org,37853,1689455451932' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-15 21:11:23,735 DEBUG [member: 'jenkins-hbase4.apache.org,37853,1689455451932' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-15 21:11:23,735 DEBUG [member: 'jenkins-hbase4.apache.org,37853,1689455451932' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,37853,1689455451932 2023-07-15 21:11:23,735 DEBUG [member: 'jenkins-hbase4.apache.org,37853,1689455451932' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-07-15 21:11:23,735 DEBUG [member: 'jenkins-hbase4.apache.org,37853,1689455451932' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,37853,1689455451932' in zk 2023-07-15 21:11:23,741 DEBUG [member: 'jenkins-hbase4.apache.org,37853,1689455451932' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-07-15 21:11:23,741 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): master:36465-0x1016ad2d8bb0000, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37853,1689455451932 2023-07-15 21:11:23,741 DEBUG [member: 'jenkins-hbase4.apache.org,37853,1689455451932' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 21:11:23,741 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37853,1689455451932 2023-07-15 21:11:23,741 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 21:11:23,741 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 21:11:23,741 DEBUG [member: 'jenkins-hbase4.apache.org,37853,1689455451932' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-07-15 21:11:23,742 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 21:11:23,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 21:11:23,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-15 21:11:23,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39075,1689455452043 2023-07-15 21:11:23,744 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39587,1689455451998 2023-07-15 21:11:23,744 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37853,1689455451932 2023-07-15 21:11:23,744 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 21:11:23,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-15 21:11:23,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39587,1689455451998 2023-07-15 21:11:23,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37853,1689455451932 2023-07-15 21:11:23,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,37853,1689455451932': 2023-07-15 21:11:23,746 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37853,1689455451932' released barrier for procedure'snaptb0-testExportFileSystemState', counting down latch. Waiting for 1 more 2023-07-15 21:11:23,749 DEBUG [Listener at jenkins-hbase4.apache.org/41711] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-15 21:11:23,750 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36465] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-15 21:11:23,750 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36465] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-15 21:11:23,750 DEBUG [Listener at jenkins-hbase4.apache.org/41711] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-15 21:11:23,755 DEBUG [rs(jenkins-hbase4.apache.org,39075,1689455452043)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,1,1689455480845.1e1f50649aa7248f9da070059fc4ce7d. completed. 2023-07-15 21:11:23,755 DEBUG [rs(jenkins-hbase4.apache.org,39075,1689455452043)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,1,1689455480845.1e1f50649aa7248f9da070059fc4ce7d. 2023-07-15 21:11:23,755 DEBUG [member: 'jenkins-hbase4.apache.org,39075,1689455452043' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-15 21:11:23,755 DEBUG [member: 'jenkins-hbase4.apache.org,39075,1689455452043' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-15 21:11:23,755 DEBUG [member: 'jenkins-hbase4.apache.org,39075,1689455452043' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,39075,1689455452043 2023-07-15 21:11:23,755 DEBUG [member: 'jenkins-hbase4.apache.org,39075,1689455452043' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-07-15 21:11:23,755 DEBUG [member: 'jenkins-hbase4.apache.org,39075,1689455452043' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,39075,1689455452043' in zk 2023-07-15 21:11:23,757 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): master:36465-0x1016ad2d8bb0000, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39075,1689455452043 2023-07-15 21:11:23,757 DEBUG [member: 'jenkins-hbase4.apache.org,39075,1689455452043' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-07-15 21:11:23,757 DEBUG [member: 'jenkins-hbase4.apache.org,39075,1689455452043' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 21:11:23,757 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39075,1689455452043 2023-07-15 21:11:23,759 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 21:11:23,759 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 21:11:23,757 DEBUG [member: 'jenkins-hbase4.apache.org,39075,1689455452043' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-07-15 21:11:23,759 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 21:11:23,759 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 21:11:23,760 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-15 21:11:23,760 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39075,1689455452043 2023-07-15 21:11:23,760 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39587,1689455451998 2023-07-15 21:11:23,761 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37853,1689455451932 2023-07-15 21:11:23,761 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 21:11:23,761 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-15 21:11:23,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39075,1689455452043 2023-07-15 21:11:23,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39587,1689455451998 2023-07-15 21:11:23,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37853,1689455451932 2023-07-15 21:11:23,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,39075,1689455452043': 2023-07-15 21:11:23,763 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39075,1689455452043' released barrier for procedure'snaptb0-testExportFileSystemState', counting down latch. Waiting for 0 more 2023-07-15 21:11:23,763 INFO [(jenkins-hbase4.apache.org,36465,1689455450507)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemState' execution completed 2023-07-15 21:11:23,763 DEBUG [(jenkins-hbase4.apache.org,36465,1689455450507)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-15 21:11:23,763 DEBUG [(jenkins-hbase4.apache.org,36465,1689455450507)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-15 21:11:23,763 DEBUG [(jenkins-hbase4.apache.org,36465,1689455450507)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemState 2023-07-15 21:11:23,763 INFO [(jenkins-hbase4.apache.org,36465,1689455450507)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-15 21:11:23,765 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): regionserver:39075-0x1016ad2d8bb0003, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-15 21:11:23,765 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): regionserver:39587-0x1016ad2d8bb0002, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-15 21:11:23,765 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-15 21:11:23,765 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-15 21:11:23,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-15 21:11:23,765 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): regionserver:39587-0x1016ad2d8bb0002, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 21:11:23,765 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): regionserver:39075-0x1016ad2d8bb0003, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 21:11:23,765 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): regionserver:37853-0x1016ad2d8bb0001, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-15 21:11:23,765 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): master:36465-0x1016ad2d8bb0000, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-15 21:11:23,765 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): regionserver:37853-0x1016ad2d8bb0001, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 21:11:23,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-15 21:11:23,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 21:11:23,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 21:11:23,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-15 21:11:23,766 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 21:11:23,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 21:11:23,765 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-15 21:11:23,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-15 21:11:23,766 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 21:11:23,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 21:11:23,766 DEBUG [(jenkins-hbase4.apache.org,36465,1689455450507)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36465-0x1016ad2d8bb0000, quorum=127.0.0.1:50024, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39075,1689455452043 2023-07-15 21:11:23,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 21:11:23,766 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 21:11:23,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 21:11:23,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-15 21:11:23,767 DEBUG [(jenkins-hbase4.apache.org,36465,1689455450507)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36465-0x1016ad2d8bb0000, quorum=127.0.0.1:50024, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39587,1689455451998 2023-07-15 21:11:23,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-15 21:11:23,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-15 21:11:23,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-15 21:11:23,779 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 21:11:23,779 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-15 21:11:23,779 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39075,1689455452043 2023-07-15 21:11:23,780 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39587,1689455451998 2023-07-15 21:11:23,780 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37853,1689455451932 2023-07-15 21:11:23,780 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 21:11:23,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-15 21:11:23,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39075,1689455452043 2023-07-15 21:11:23,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39587,1689455451998 2023-07-15 21:11:23,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37853,1689455451932 2023-07-15 21:11:23,784 DEBUG [(jenkins-hbase4.apache.org,36465,1689455450507)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36465-0x1016ad2d8bb0000, quorum=127.0.0.1:50024, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37853,1689455451932 2023-07-15 21:11:23,786 DEBUG [(jenkins-hbase4.apache.org,36465,1689455450507)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36465-0x1016ad2d8bb0000, quorum=127.0.0.1:50024, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39075,1689455452043 2023-07-15 21:11:23,787 DEBUG [(jenkins-hbase4.apache.org,36465,1689455450507)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36465-0x1016ad2d8bb0000, quorum=127.0.0.1:50024, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39587,1689455451998 2023-07-15 21:11:23,787 DEBUG [(jenkins-hbase4.apache.org,36465,1689455450507)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36465-0x1016ad2d8bb0000, quorum=127.0.0.1:50024, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37853,1689455451932 2023-07-15 21:11:23,791 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): regionserver:39587-0x1016ad2d8bb0002, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 21:11:23,791 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): master:36465-0x1016ad2d8bb0000, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37853,1689455451932 2023-07-15 21:11:23,791 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): regionserver:37853-0x1016ad2d8bb0001, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 21:11:23,791 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): regionserver:39587-0x1016ad2d8bb0002, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 21:11:23,791 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): regionserver:39075-0x1016ad2d8bb0003, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 21:11:23,791 DEBUG [(jenkins-hbase4.apache.org,36465,1689455450507)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 21:11:23,791 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 21:11:23,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 21:11:23,791 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 21:11:23,793 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 21:11:23,791 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): regionserver:39075-0x1016ad2d8bb0003, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 21:11:23,791 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemState 2023-07-15 21:11:23,791 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 21:11:23,793 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 21:11:23,791 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): regionserver:37853-0x1016ad2d8bb0001, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 21:11:23,794 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 21:11:23,794 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 21:11:23,794 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 21:11:23,794 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 21:11:23,794 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 21:11:23,794 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 21:11:23,791 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): master:36465-0x1016ad2d8bb0000, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-15 21:11:23,793 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemState 2023-07-15 21:11:23,795 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 8c2558c0b59bb3a4e2e578c2c8e8915d, NAME => 'testtb-testExportFileSystemState,.mob,0.8c2558c0b59bb3a4e2e578c2c8e8915d.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportFileSystemState 2023-07-15 21:11:23,795 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): master:36465-0x1016ad2d8bb0000, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39587,1689455451998 2023-07-15 21:11:23,795 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-15 21:11:23,795 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): master:36465-0x1016ad2d8bb0000, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39075,1689455452043 2023-07-15 21:11:23,795 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): master:36465-0x1016ad2d8bb0000, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-15 21:11:23,795 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): master:36465-0x1016ad2d8bb0000, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37853,1689455451932 2023-07-15 21:11:23,795 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): master:36465-0x1016ad2d8bb0000, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-15 21:11:23,795 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): master:36465-0x1016ad2d8bb0000, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39587,1689455451998 2023-07-15 21:11:23,795 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): master:36465-0x1016ad2d8bb0000, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39075,1689455452043 2023-07-15 21:11:23,795 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): master:36465-0x1016ad2d8bb0000, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-15 21:11:23,795 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): master:36465-0x1016ad2d8bb0000, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-15 21:11:23,796 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b20230715c28ece4e3c3148cca34d854b4aa80365, hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e20230715f8b83d206ff44968a964f5a275e78ce1] mob files 2023-07-15 21:11:23,796 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b20230715c28ece4e3c3148cca34d854b4aa80365 2023-07-15 21:11:23,796 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e20230715f8b83d206ff44968a964f5a275e78ce1 2023-07-15 21:11:23,842 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemState 2023-07-15 21:11:23,843 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-15 21:11:23,897 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState to hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-07-15 21:11:23,929 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed 2023-07-15 21:11:23,930 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-15 21:11:23,930 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-15 21:11:23,930 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState at 1689455483442Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemState at 1689455483842 (+400 ms)Consolidate snapshot: snaptb0-testExportFileSystemState at 1689455483842Loading Region manifests for snaptb0-testExportFileSystemState at 1689455483842Writing data manifest for snaptb0-testExportFileSystemState at 1689455483856 (+14 ms)Verifying snapshot: snaptb0-testExportFileSystemState at 1689455483883 (+27 ms)Snapshot snaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed at 1689455483929 (+46 ms) 2023-07-15 21:11:23,934 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=35, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-15 21:11:23,936 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=35, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED in 491 msec 2023-07-15 21:11:24,050 DEBUG [Listener at jenkins-hbase4.apache.org/41711] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-15 21:11:24,051 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36465] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-15 21:11:24,052 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36465] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-15 21:11:24,052 INFO [Listener at jenkins-hbase4.apache.org/41711] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/export-test/export-1689455484052 2023-07-15 21:11:24,052 INFO [Listener at jenkins-hbase4.apache.org/41711] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:46859, tgtDir=hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/export-test/export-1689455484052, rawTgtDir=hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/export-test/export-1689455484052, srcFsUri=hdfs://localhost:46859, srcDir=hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313 2023-07-15 21:11:24,075 DEBUG [Listener at jenkins-hbase4.apache.org/41711] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:46859, inputRoot=hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313 2023-07-15 21:11:24,075 DEBUG [Listener at jenkins-hbase4.apache.org/41711] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-763184170_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/export-test/export-1689455484052, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/export-test/export-1689455484052/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-15 21:11:24,076 INFO [Listener at jenkins-hbase4.apache.org/41711] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:46859, inputRoot=hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313, snapshotDir=hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/.hbase-snapshot/snaptb0-testExportFileSystemState. 2023-07-15 21:11:24,090 INFO [Listener at jenkins-hbase4.apache.org/41711] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/.hbase-snapshot/snaptb0-testExportFileSystemState to hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/export-test/export-1689455484052/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-15 21:11:24,121 DEBUG [Listener at jenkins-hbase4.apache.org/41711] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-15 21:11:24,122 DEBUG [Listener at jenkins-hbase4.apache.org/41711] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-15 21:11:24,123 DEBUG [Listener at jenkins-hbase4.apache.org/41711] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-15 21:11:24,123 DEBUG [Listener at jenkins-hbase4.apache.org/41711] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-15 21:11:24,124 DEBUG [Listener at jenkins-hbase4.apache.org/41711] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-15 21:11:24,124 DEBUG [Listener at jenkins-hbase4.apache.org/41711] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-15 21:11:24,125 DEBUG [Listener at jenkins-hbase4.apache.org/41711] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-15 21:11:24,211 DEBUG [Listener at jenkins-hbase4.apache.org/41711] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/de3e87f0-08fc-c0d0-c969-4c410fd4e6fd/hadoop-8597445869039737816.jar 2023-07-15 21:11:24,212 DEBUG [Listener at jenkins-hbase4.apache.org/41711] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-15 21:11:24,212 DEBUG [Listener at jenkins-hbase4.apache.org/41711] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-15 21:11:24,213 DEBUG [Listener at jenkins-hbase4.apache.org/41711] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-15 21:11:24,213 DEBUG [Listener at jenkins-hbase4.apache.org/41711] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-15 21:11:24,213 DEBUG [Listener at jenkins-hbase4.apache.org/41711] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-15 21:11:24,214 DEBUG [Listener at jenkins-hbase4.apache.org/41711] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-15 21:11:24,214 DEBUG [Listener at jenkins-hbase4.apache.org/41711] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-15 21:11:24,214 DEBUG [Listener at jenkins-hbase4.apache.org/41711] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-15 21:11:24,215 DEBUG [Listener at jenkins-hbase4.apache.org/41711] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-15 21:11:24,215 DEBUG [Listener at jenkins-hbase4.apache.org/41711] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-15 21:11:24,216 DEBUG [Listener at jenkins-hbase4.apache.org/41711] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-15 21:11:24,216 DEBUG [Listener at jenkins-hbase4.apache.org/41711] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-15 21:11:24,217 DEBUG [Listener at jenkins-hbase4.apache.org/41711] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-15 21:11:24,217 DEBUG [Listener at jenkins-hbase4.apache.org/41711] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-15 21:11:24,217 DEBUG [Listener at jenkins-hbase4.apache.org/41711] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-15 21:11:24,218 DEBUG [Listener at jenkins-hbase4.apache.org/41711] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-15 21:11:24,218 DEBUG [Listener at jenkins-hbase4.apache.org/41711] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-15 21:11:24,219 DEBUG [Listener at jenkins-hbase4.apache.org/41711] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-15 21:11:24,219 DEBUG [Listener at jenkins-hbase4.apache.org/41711] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-15 21:11:24,219 DEBUG [Listener at jenkins-hbase4.apache.org/41711] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-15 21:11:24,219 DEBUG [Listener at jenkins-hbase4.apache.org/41711] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-15 21:11:24,220 DEBUG [Listener at jenkins-hbase4.apache.org/41711] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-15 21:11:24,220 DEBUG [Listener at jenkins-hbase4.apache.org/41711] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-15 21:11:24,821 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689455459463_0001_000001 (auth:SIMPLE) 2023-07-15 21:11:24,914 WARN [Listener at jenkins-hbase4.apache.org/41711] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-15 21:11:24,917 INFO [Listener at jenkins-hbase4.apache.org/41711] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemState' hfile list 2023-07-15 21:11:24,920 DEBUG [Listener at jenkins-hbase4.apache.org/41711] snapshot.ExportSnapshot(671): export split=0 size=30.9 K 2023-07-15 21:11:25,041 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-15 21:11:25,041 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-15 21:11:25,694 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689455459463_0002_000001 (auth:SIMPLE) 2023-07-15 21:11:26,128 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-15 21:11:30,419 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689455459463_0002_000001 (auth:SIMPLE) 2023-07-15 21:11:32,628 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689455459463_0002_000001 (auth:SIMPLE) 2023-07-15 21:11:35,750 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689455459463_0002_000001 (auth:SIMPLE) 2023-07-15 21:11:37,172 INFO [Listener at jenkins-hbase4.apache.org/41711] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-15 21:11:37,176 INFO [Listener at jenkins-hbase4.apache.org/41711] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-15 21:11:37,185 INFO [Listener at jenkins-hbase4.apache.org/41711] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemState 2023-07-15 21:11:37,185 INFO [Listener at jenkins-hbase4.apache.org/41711] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-15 21:11:37,186 INFO [Listener at jenkins-hbase4.apache.org/41711] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-15 21:11:37,186 DEBUG [Listener at jenkins-hbase4.apache.org/41711] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1600112846_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/.hbase-snapshot/snaptb0-testExportFileSystemState at hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-07-15 21:11:37,187 DEBUG [Listener at jenkins-hbase4.apache.org/41711] snapshot.TestExportSnapshot(367): hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/.hbase-snapshot/snaptb0-testExportFileSystemState/.snapshotinfo 2023-07-15 21:11:37,187 DEBUG [Listener at jenkins-hbase4.apache.org/41711] snapshot.TestExportSnapshot(367): hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/.hbase-snapshot/snaptb0-testExportFileSystemState/data.manifest 2023-07-15 21:11:37,187 DEBUG [Listener at jenkins-hbase4.apache.org/41711] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1600112846_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/export-test/export-1689455484052/.hbase-snapshot/snaptb0-testExportFileSystemState at hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/export-test/export-1689455484052/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-07-15 21:11:37,188 DEBUG [Listener at jenkins-hbase4.apache.org/41711] snapshot.TestExportSnapshot(367): hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/export-test/export-1689455484052/.hbase-snapshot/snaptb0-testExportFileSystemState/.snapshotinfo 2023-07-15 21:11:37,188 DEBUG [Listener at jenkins-hbase4.apache.org/41711] snapshot.TestExportSnapshot(367): hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/export-test/export-1689455484052/.hbase-snapshot/snaptb0-testExportFileSystemState/data.manifest 2023-07-15 21:11:37,195 INFO [Listener at jenkins-hbase4.apache.org/41711] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemState 2023-07-15 21:11:37,196 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36465] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemState 2023-07-15 21:11:37,197 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36465] procedure2.ProcedureExecutor(1029): Stored pid=36, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemState 2023-07-15 21:11:37,201 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36465] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-07-15 21:11:37,202 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689455497202"}]},"ts":"1689455497202"} 2023-07-15 21:11:37,204 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=DISABLING in hbase:meta 2023-07-15 21:11:37,205 INFO [PEWorker-5] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemState to state=DISABLING 2023-07-15 21:11:37,206 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=37, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=faf012332edd8fd89b4f1b924a8cd490, UNASSIGN}, {pid=38, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=1e1f50649aa7248f9da070059fc4ce7d, UNASSIGN}] 2023-07-15 21:11:37,209 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=37, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=faf012332edd8fd89b4f1b924a8cd490, UNASSIGN 2023-07-15 21:11:37,209 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=38, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=1e1f50649aa7248f9da070059fc4ce7d, UNASSIGN 2023-07-15 21:11:37,210 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=faf012332edd8fd89b4f1b924a8cd490, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,37853,1689455451932 2023-07-15 21:11:37,210 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=1e1f50649aa7248f9da070059fc4ce7d, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,39075,1689455452043 2023-07-15 21:11:37,210 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,,1689455480845.faf012332edd8fd89b4f1b924a8cd490.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689455497210"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689455497210"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689455497210"}]},"ts":"1689455497210"} 2023-07-15 21:11:37,210 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,1,1689455480845.1e1f50649aa7248f9da070059fc4ce7d.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689455497210"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689455497210"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689455497210"}]},"ts":"1689455497210"} 2023-07-15 21:11:37,211 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=39, ppid=38, state=RUNNABLE; CloseRegionProcedure 1e1f50649aa7248f9da070059fc4ce7d, server=jenkins-hbase4.apache.org,39075,1689455452043}] 2023-07-15 21:11:37,212 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=40, ppid=37, state=RUNNABLE; CloseRegionProcedure faf012332edd8fd89b4f1b924a8cd490, server=jenkins-hbase4.apache.org,37853,1689455451932}] 2023-07-15 21:11:37,303 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36465] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-07-15 21:11:37,364 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 1e1f50649aa7248f9da070059fc4ce7d 2023-07-15 21:11:37,364 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 1e1f50649aa7248f9da070059fc4ce7d, disabling compactions & flushes 2023-07-15 21:11:37,364 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,1,1689455480845.1e1f50649aa7248f9da070059fc4ce7d. 2023-07-15 21:11:37,364 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,1,1689455480845.1e1f50649aa7248f9da070059fc4ce7d. 2023-07-15 21:11:37,364 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,1,1689455480845.1e1f50649aa7248f9da070059fc4ce7d. after waiting 0 ms 2023-07-15 21:11:37,364 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,1,1689455480845.1e1f50649aa7248f9da070059fc4ce7d. 2023-07-15 21:11:37,368 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close faf012332edd8fd89b4f1b924a8cd490 2023-07-15 21:11:37,368 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing faf012332edd8fd89b4f1b924a8cd490, disabling compactions & flushes 2023-07-15 21:11:37,368 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,,1689455480845.faf012332edd8fd89b4f1b924a8cd490. 2023-07-15 21:11:37,368 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,,1689455480845.faf012332edd8fd89b4f1b924a8cd490. 2023-07-15 21:11:37,369 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,,1689455480845.faf012332edd8fd89b4f1b924a8cd490. after waiting 0 ms 2023-07-15 21:11:37,369 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,,1689455480845.faf012332edd8fd89b4f1b924a8cd490. 2023-07-15 21:11:37,380 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/data/default/testtb-testExportFileSystemState/1e1f50649aa7248f9da070059fc4ce7d/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-15 21:11:37,380 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/data/default/testtb-testExportFileSystemState/faf012332edd8fd89b4f1b924a8cd490/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-15 21:11:37,381 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-15 21:11:37,381 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-15 21:11:37,381 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,1,1689455480845.1e1f50649aa7248f9da070059fc4ce7d. 2023-07-15 21:11:37,382 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 1e1f50649aa7248f9da070059fc4ce7d: 2023-07-15 21:11:37,382 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,,1689455480845.faf012332edd8fd89b4f1b924a8cd490. 2023-07-15 21:11:37,382 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for faf012332edd8fd89b4f1b924a8cd490: 2023-07-15 21:11:37,384 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed faf012332edd8fd89b4f1b924a8cd490 2023-07-15 21:11:37,385 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=faf012332edd8fd89b4f1b924a8cd490, regionState=CLOSED 2023-07-15 21:11:37,385 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,,1689455480845.faf012332edd8fd89b4f1b924a8cd490.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689455497385"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689455497385"}]},"ts":"1689455497385"} 2023-07-15 21:11:37,385 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 1e1f50649aa7248f9da070059fc4ce7d 2023-07-15 21:11:37,385 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=1e1f50649aa7248f9da070059fc4ce7d, regionState=CLOSED 2023-07-15 21:11:37,386 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,1,1689455480845.1e1f50649aa7248f9da070059fc4ce7d.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689455497385"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689455497385"}]},"ts":"1689455497385"} 2023-07-15 21:11:37,388 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=40, resume processing ppid=37 2023-07-15 21:11:37,388 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=40, ppid=37, state=SUCCESS; CloseRegionProcedure faf012332edd8fd89b4f1b924a8cd490, server=jenkins-hbase4.apache.org,37853,1689455451932 in 174 msec 2023-07-15 21:11:37,389 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=39, resume processing ppid=38 2023-07-15 21:11:37,389 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=39, ppid=38, state=SUCCESS; CloseRegionProcedure 1e1f50649aa7248f9da070059fc4ce7d, server=jenkins-hbase4.apache.org,39075,1689455452043 in 176 msec 2023-07-15 21:11:37,390 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=37, ppid=36, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=faf012332edd8fd89b4f1b924a8cd490, UNASSIGN in 182 msec 2023-07-15 21:11:37,391 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=38, resume processing ppid=36 2023-07-15 21:11:37,391 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=38, ppid=36, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=1e1f50649aa7248f9da070059fc4ce7d, UNASSIGN in 183 msec 2023-07-15 21:11:37,392 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689455497392"}]},"ts":"1689455497392"} 2023-07-15 21:11:37,393 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=DISABLED in hbase:meta 2023-07-15 21:11:37,395 INFO [PEWorker-4] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemState to state=DISABLED 2023-07-15 21:11:37,398 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=36, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemState in 200 msec 2023-07-15 21:11:37,504 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36465] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-07-15 21:11:37,505 INFO [Listener at jenkins-hbase4.apache.org/41711] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemState, procId: 36 completed 2023-07-15 21:11:37,505 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36465] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemState 2023-07-15 21:11:37,507 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36465] procedure2.ProcedureExecutor(1029): Stored pid=41, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-15 21:11:37,509 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=41, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-15 21:11:37,509 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36465] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemState 2023-07-15 21:11:37,510 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=41, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-15 21:11:37,511 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=39075] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemState 2023-07-15 21:11:37,514 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): regionserver:39587-0x1016ad2d8bb0002, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-15 21:11:37,514 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): regionserver:39075-0x1016ad2d8bb0003, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-15 21:11:37,514 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): master:36465-0x1016ad2d8bb0000, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-15 21:11:37,514 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): regionserver:37853-0x1016ad2d8bb0001, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-15 21:11:37,514 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-07-15 21:11:37,515 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-07-15 21:11:37,515 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-07-15 21:11:37,515 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-07-15 21:11:37,515 DEBUG [HFileArchiver-9] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/.tmp/data/default/testtb-testExportFileSystemState/faf012332edd8fd89b4f1b924a8cd490 2023-07-15 21:11:37,516 DEBUG [HFileArchiver-10] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/.tmp/data/default/testtb-testExportFileSystemState/1e1f50649aa7248f9da070059fc4ce7d 2023-07-15 21:11:37,516 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): master:36465-0x1016ad2d8bb0000, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-15 21:11:37,517 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): master:36465-0x1016ad2d8bb0000, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 21:11:37,517 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): regionserver:37853-0x1016ad2d8bb0001, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-15 21:11:37,517 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): regionserver:37853-0x1016ad2d8bb0001, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 21:11:37,517 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): regionserver:39587-0x1016ad2d8bb0002, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-15 21:11:37,517 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): regionserver:39075-0x1016ad2d8bb0003, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-15 21:11:37,517 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): regionserver:39587-0x1016ad2d8bb0002, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 21:11:37,517 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): regionserver:39075-0x1016ad2d8bb0003, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 21:11:37,518 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36465] master.MasterRpcServices(1230): Checking to see if procedure is done pid=41 2023-07-15 21:11:37,518 DEBUG [HFileArchiver-9] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/.tmp/data/default/testtb-testExportFileSystemState/faf012332edd8fd89b4f1b924a8cd490/cf, FileablePath, hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/.tmp/data/default/testtb-testExportFileSystemState/faf012332edd8fd89b4f1b924a8cd490/recovered.edits] 2023-07-15 21:11:37,518 DEBUG [HFileArchiver-10] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/.tmp/data/default/testtb-testExportFileSystemState/1e1f50649aa7248f9da070059fc4ce7d/cf, FileablePath, hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/.tmp/data/default/testtb-testExportFileSystemState/1e1f50649aa7248f9da070059fc4ce7d/recovered.edits] 2023-07-15 21:11:37,523 DEBUG [HFileArchiver-9] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/.tmp/data/default/testtb-testExportFileSystemState/faf012332edd8fd89b4f1b924a8cd490/cf/a5cbb1d72a5d4b28af3ebff15ef190ae to hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/archive/data/default/testtb-testExportFileSystemState/faf012332edd8fd89b4f1b924a8cd490/cf/a5cbb1d72a5d4b28af3ebff15ef190ae 2023-07-15 21:11:37,523 DEBUG [HFileArchiver-10] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/.tmp/data/default/testtb-testExportFileSystemState/1e1f50649aa7248f9da070059fc4ce7d/cf/30e5a9b9b62d48e2a35d9bb89ff867df to hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/archive/data/default/testtb-testExportFileSystemState/1e1f50649aa7248f9da070059fc4ce7d/cf/30e5a9b9b62d48e2a35d9bb89ff867df 2023-07-15 21:11:37,527 DEBUG [HFileArchiver-10] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/.tmp/data/default/testtb-testExportFileSystemState/1e1f50649aa7248f9da070059fc4ce7d/recovered.edits/9.seqid to hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/archive/data/default/testtb-testExportFileSystemState/1e1f50649aa7248f9da070059fc4ce7d/recovered.edits/9.seqid 2023-07-15 21:11:37,527 DEBUG [HFileArchiver-9] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/.tmp/data/default/testtb-testExportFileSystemState/faf012332edd8fd89b4f1b924a8cd490/recovered.edits/9.seqid to hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/archive/data/default/testtb-testExportFileSystemState/faf012332edd8fd89b4f1b924a8cd490/recovered.edits/9.seqid 2023-07-15 21:11:37,528 DEBUG [HFileArchiver-10] backup.HFileArchiver(596): Deleted hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/.tmp/data/default/testtb-testExportFileSystemState/1e1f50649aa7248f9da070059fc4ce7d 2023-07-15 21:11:37,528 DEBUG [HFileArchiver-9] backup.HFileArchiver(596): Deleted hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/.tmp/data/default/testtb-testExportFileSystemState/faf012332edd8fd89b4f1b924a8cd490 2023-07-15 21:11:37,528 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemState regions 2023-07-15 21:11:37,528 DEBUG [PEWorker-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d 2023-07-15 21:11:37,529 DEBUG [PEWorker-3] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf] 2023-07-15 21:11:37,534 DEBUG [PEWorker-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b20230715c28ece4e3c3148cca34d854b4aa80365 to hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/archive/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b20230715c28ece4e3c3148cca34d854b4aa80365 2023-07-15 21:11:37,535 DEBUG [PEWorker-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e20230715f8b83d206ff44968a964f5a275e78ce1 to hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/archive/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e20230715f8b83d206ff44968a964f5a275e78ce1 2023-07-15 21:11:37,536 DEBUG [PEWorker-3] backup.HFileArchiver(596): Deleted hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d 2023-07-15 21:11:37,539 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=41, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-15 21:11:37,541 WARN [PEWorker-3] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemState from hbase:meta 2023-07-15 21:11:37,543 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemState' descriptor. 2023-07-15 21:11:37,545 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=41, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-15 21:11:37,545 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemState' from region states. 2023-07-15 21:11:37,545 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState,,1689455480845.faf012332edd8fd89b4f1b924a8cd490.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689455497545"}]},"ts":"9223372036854775807"} 2023-07-15 21:11:37,545 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState,1,1689455480845.1e1f50649aa7248f9da070059fc4ce7d.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689455497545"}]},"ts":"9223372036854775807"} 2023-07-15 21:11:37,547 INFO [PEWorker-3] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-15 21:11:37,547 DEBUG [PEWorker-3] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => faf012332edd8fd89b4f1b924a8cd490, NAME => 'testtb-testExportFileSystemState,,1689455480845.faf012332edd8fd89b4f1b924a8cd490.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 1e1f50649aa7248f9da070059fc4ce7d, NAME => 'testtb-testExportFileSystemState,1,1689455480845.1e1f50649aa7248f9da070059fc4ce7d.', STARTKEY => '1', ENDKEY => ''}] 2023-07-15 21:11:37,547 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemState' as deleted. 2023-07-15 21:11:37,547 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689455497547"}]},"ts":"9223372036854775807"} 2023-07-15 21:11:37,548 INFO [PEWorker-3] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemState state from META 2023-07-15 21:11:37,550 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(130): Finished pid=41, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-15 21:11:37,552 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=41, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemState in 45 msec 2023-07-15 21:11:37,619 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36465] master.MasterRpcServices(1230): Checking to see if procedure is done pid=41 2023-07-15 21:11:37,619 INFO [Listener at jenkins-hbase4.apache.org/41711] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemState, procId: 41 completed 2023-07-15 21:11:37,630 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36465] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportFileSystemState" 2023-07-15 21:11:37,633 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36465] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemState 2023-07-15 21:11:37,635 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36465] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemState" 2023-07-15 21:11:37,638 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36465] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemState 2023-07-15 21:11:37,671 INFO [Listener at jenkins-hbase4.apache.org/41711] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportFileSystemState Thread=765 (was 753) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1917081060_1 at /127.0.0.1:33588 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ContainersLauncher #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-2146 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: ApplicationMasterLauncher #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LogDeleter #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-3-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-7 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-8 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1600112846_17 at /127.0.0.1:33610 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x401a2f8d-shared-pool-18 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1917081060_1 at /127.0.0.1:35394 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (2038956992) connection to jenkins-hbase4.apache.org/172.31.14.131:43321 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: hconnection-0x401a2f8d-shared-pool-19 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-4 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1600112846_17 at /127.0.0.1:35408 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-3-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1600112846_17 at /127.0.0.1:51982 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x401a2f8d-shared-pool-17 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x401a2f8d-shared-pool-16 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LogDeleter #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=925 (was 931), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=317 (was 303) - SystemLoadAverage LEAK? -, ProcessCount=180 (was 180), AvailableMemoryMB=2922 (was 3216) 2023-07-15 21:11:37,671 WARN [Listener at jenkins-hbase4.apache.org/41711] hbase.ResourceChecker(130): Thread=765 is superior to 500 2023-07-15 21:11:37,695 INFO [Listener at jenkins-hbase4.apache.org/41711] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testConsecutiveExports Thread=765, OpenFileDescriptor=925, MaxFileDescriptor=60000, SystemLoadAverage=317, ProcessCount=180, AvailableMemoryMB=2922 2023-07-15 21:11:37,695 WARN [Listener at jenkins-hbase4.apache.org/41711] hbase.ResourceChecker(130): Thread=765 is superior to 500 2023-07-15 21:11:37,697 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36465] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-07-15 21:11:37,700 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36465] procedure2.ProcedureExecutor(1029): Stored pid=42, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testConsecutiveExports 2023-07-15 21:11:37,703 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_PRE_OPERATION 2023-07-15 21:11:37,703 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36465] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testConsecutiveExports" procId is: 42 2023-07-15 21:11:37,704 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-15 21:11:37,705 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36465] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-15 21:11:37,708 DEBUG [HFileArchiver-11] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/.tmp/data/default/testtb-testConsecutiveExports/d78c68a1a90e6c0d85455c22a0d38646 2023-07-15 21:11:37,710 DEBUG [HFileArchiver-11] backup.HFileArchiver(153): Directory hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/.tmp/data/default/testtb-testConsecutiveExports/d78c68a1a90e6c0d85455c22a0d38646 empty. 2023-07-15 21:11:37,711 DEBUG [HFileArchiver-12] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/.tmp/data/default/testtb-testConsecutiveExports/1fb30bff8fea9087e0ff20afd85442f9 2023-07-15 21:11:37,711 DEBUG [HFileArchiver-11] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/.tmp/data/default/testtb-testConsecutiveExports/d78c68a1a90e6c0d85455c22a0d38646 2023-07-15 21:11:37,711 DEBUG [HFileArchiver-12] backup.HFileArchiver(153): Directory hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/.tmp/data/default/testtb-testConsecutiveExports/1fb30bff8fea9087e0ff20afd85442f9 empty. 2023-07-15 21:11:37,712 DEBUG [HFileArchiver-12] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/.tmp/data/default/testtb-testConsecutiveExports/1fb30bff8fea9087e0ff20afd85442f9 2023-07-15 21:11:37,712 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testConsecutiveExports regions 2023-07-15 21:11:37,730 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/.tmp/data/default/testtb-testConsecutiveExports/.tabledesc/.tableinfo.0000000001 2023-07-15 21:11:37,739 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(7675): creating {ENCODED => d78c68a1a90e6c0d85455c22a0d38646, NAME => 'testtb-testConsecutiveExports,,1689455497697.d78c68a1a90e6c0d85455c22a0d38646.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/.tmp 2023-07-15 21:11:37,741 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(7675): creating {ENCODED => 1fb30bff8fea9087e0ff20afd85442f9, NAME => 'testtb-testConsecutiveExports,1,1689455497697.1fb30bff8fea9087e0ff20afd85442f9.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/.tmp 2023-07-15 21:11:37,782 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,1,1689455497697.1fb30bff8fea9087e0ff20afd85442f9.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-15 21:11:37,782 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1604): Closing 1fb30bff8fea9087e0ff20afd85442f9, disabling compactions & flushes 2023-07-15 21:11:37,782 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,1,1689455497697.1fb30bff8fea9087e0ff20afd85442f9. 2023-07-15 21:11:37,782 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,1,1689455497697.1fb30bff8fea9087e0ff20afd85442f9. 2023-07-15 21:11:37,782 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,1,1689455497697.1fb30bff8fea9087e0ff20afd85442f9. after waiting 0 ms 2023-07-15 21:11:37,782 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,1,1689455497697.1fb30bff8fea9087e0ff20afd85442f9. 2023-07-15 21:11:37,782 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,1,1689455497697.1fb30bff8fea9087e0ff20afd85442f9. 2023-07-15 21:11:37,782 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1558): Region close journal for 1fb30bff8fea9087e0ff20afd85442f9: 2023-07-15 21:11:37,783 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,,1689455497697.d78c68a1a90e6c0d85455c22a0d38646.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-15 21:11:37,783 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1604): Closing d78c68a1a90e6c0d85455c22a0d38646, disabling compactions & flushes 2023-07-15 21:11:37,783 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,,1689455497697.d78c68a1a90e6c0d85455c22a0d38646. 2023-07-15 21:11:37,783 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,,1689455497697.d78c68a1a90e6c0d85455c22a0d38646. 2023-07-15 21:11:37,783 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,,1689455497697.d78c68a1a90e6c0d85455c22a0d38646. after waiting 0 ms 2023-07-15 21:11:37,783 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,,1689455497697.d78c68a1a90e6c0d85455c22a0d38646. 2023-07-15 21:11:37,783 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,,1689455497697.d78c68a1a90e6c0d85455c22a0d38646. 2023-07-15 21:11:37,783 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1558): Region close journal for d78c68a1a90e6c0d85455c22a0d38646: 2023-07-15 21:11:37,786 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_ADD_TO_META 2023-07-15 21:11:37,788 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,1,1689455497697.1fb30bff8fea9087e0ff20afd85442f9.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689455497787"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689455497787"}]},"ts":"1689455497787"} 2023-07-15 21:11:37,788 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,,1689455497697.d78c68a1a90e6c0d85455c22a0d38646.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689455497787"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689455497787"}]},"ts":"1689455497787"} 2023-07-15 21:11:37,792 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-15 21:11:37,796 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-15 21:11:37,797 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689455497796"}]},"ts":"1689455497796"} 2023-07-15 21:11:37,798 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=ENABLING in hbase:meta 2023-07-15 21:11:37,802 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-15 21:11:37,803 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-15 21:11:37,803 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-15 21:11:37,803 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-15 21:11:37,803 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-15 21:11:37,804 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=d78c68a1a90e6c0d85455c22a0d38646, ASSIGN}, {pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=1fb30bff8fea9087e0ff20afd85442f9, ASSIGN}] 2023-07-15 21:11:37,807 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=d78c68a1a90e6c0d85455c22a0d38646, ASSIGN 2023-07-15 21:11:37,807 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=1fb30bff8fea9087e0ff20afd85442f9, ASSIGN 2023-07-15 21:11:37,807 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36465] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-15 21:11:37,808 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=d78c68a1a90e6c0d85455c22a0d38646, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,39587,1689455451998; forceNewPlan=false, retain=false 2023-07-15 21:11:37,808 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=1fb30bff8fea9087e0ff20afd85442f9, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,39075,1689455452043; forceNewPlan=false, retain=false 2023-07-15 21:11:37,958 INFO [jenkins-hbase4:36465] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-15 21:11:37,961 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=d78c68a1a90e6c0d85455c22a0d38646, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,39587,1689455451998 2023-07-15 21:11:37,961 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=44 updating hbase:meta row=1fb30bff8fea9087e0ff20afd85442f9, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,39075,1689455452043 2023-07-15 21:11:37,962 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,,1689455497697.d78c68a1a90e6c0d85455c22a0d38646.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689455497961"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689455497961"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689455497961"}]},"ts":"1689455497961"} 2023-07-15 21:11:37,962 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,1,1689455497697.1fb30bff8fea9087e0ff20afd85442f9.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689455497961"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689455497961"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689455497961"}]},"ts":"1689455497961"} 2023-07-15 21:11:37,964 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=45, ppid=43, state=RUNNABLE; OpenRegionProcedure d78c68a1a90e6c0d85455c22a0d38646, server=jenkins-hbase4.apache.org,39587,1689455451998}] 2023-07-15 21:11:37,966 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=46, ppid=44, state=RUNNABLE; OpenRegionProcedure 1fb30bff8fea9087e0ff20afd85442f9, server=jenkins-hbase4.apache.org,39075,1689455452043}] 2023-07-15 21:11:38,009 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36465] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-15 21:11:38,130 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testConsecutiveExports,,1689455497697.d78c68a1a90e6c0d85455c22a0d38646. 2023-07-15 21:11:38,130 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => d78c68a1a90e6c0d85455c22a0d38646, NAME => 'testtb-testConsecutiveExports,,1689455497697.d78c68a1a90e6c0d85455c22a0d38646.', STARTKEY => '', ENDKEY => '1'} 2023-07-15 21:11:38,130 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testConsecutiveExports,,1689455497697.d78c68a1a90e6c0d85455c22a0d38646. service=AccessControlService 2023-07-15 21:11:38,130 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testConsecutiveExports,1,1689455497697.1fb30bff8fea9087e0ff20afd85442f9. 2023-07-15 21:11:38,130 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-15 21:11:38,130 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1fb30bff8fea9087e0ff20afd85442f9, NAME => 'testtb-testConsecutiveExports,1,1689455497697.1fb30bff8fea9087e0ff20afd85442f9.', STARTKEY => '1', ENDKEY => ''} 2023-07-15 21:11:38,131 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testConsecutiveExports d78c68a1a90e6c0d85455c22a0d38646 2023-07-15 21:11:38,131 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,,1689455497697.d78c68a1a90e6c0d85455c22a0d38646.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-15 21:11:38,131 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for d78c68a1a90e6c0d85455c22a0d38646 2023-07-15 21:11:38,131 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for d78c68a1a90e6c0d85455c22a0d38646 2023-07-15 21:11:38,131 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testConsecutiveExports,1,1689455497697.1fb30bff8fea9087e0ff20afd85442f9. service=AccessControlService 2023-07-15 21:11:38,131 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-15 21:11:38,131 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testConsecutiveExports 1fb30bff8fea9087e0ff20afd85442f9 2023-07-15 21:11:38,131 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,1,1689455497697.1fb30bff8fea9087e0ff20afd85442f9.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-15 21:11:38,131 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 1fb30bff8fea9087e0ff20afd85442f9 2023-07-15 21:11:38,131 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 1fb30bff8fea9087e0ff20afd85442f9 2023-07-15 21:11:38,133 INFO [StoreOpener-1fb30bff8fea9087e0ff20afd85442f9-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 1fb30bff8fea9087e0ff20afd85442f9 2023-07-15 21:11:38,134 INFO [StoreOpener-d78c68a1a90e6c0d85455c22a0d38646-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region d78c68a1a90e6c0d85455c22a0d38646 2023-07-15 21:11:38,134 DEBUG [StoreOpener-1fb30bff8fea9087e0ff20afd85442f9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/data/default/testtb-testConsecutiveExports/1fb30bff8fea9087e0ff20afd85442f9/cf 2023-07-15 21:11:38,134 DEBUG [StoreOpener-1fb30bff8fea9087e0ff20afd85442f9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/data/default/testtb-testConsecutiveExports/1fb30bff8fea9087e0ff20afd85442f9/cf 2023-07-15 21:11:38,135 INFO [StoreOpener-1fb30bff8fea9087e0ff20afd85442f9-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1fb30bff8fea9087e0ff20afd85442f9 columnFamilyName cf 2023-07-15 21:11:38,136 DEBUG [StoreOpener-d78c68a1a90e6c0d85455c22a0d38646-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/data/default/testtb-testConsecutiveExports/d78c68a1a90e6c0d85455c22a0d38646/cf 2023-07-15 21:11:38,136 DEBUG [StoreOpener-d78c68a1a90e6c0d85455c22a0d38646-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/data/default/testtb-testConsecutiveExports/d78c68a1a90e6c0d85455c22a0d38646/cf 2023-07-15 21:11:38,136 INFO [StoreOpener-d78c68a1a90e6c0d85455c22a0d38646-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d78c68a1a90e6c0d85455c22a0d38646 columnFamilyName cf 2023-07-15 21:11:38,136 INFO [StoreOpener-1fb30bff8fea9087e0ff20afd85442f9-1] regionserver.HStore(310): Store=1fb30bff8fea9087e0ff20afd85442f9/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-15 21:11:38,137 INFO [StoreOpener-d78c68a1a90e6c0d85455c22a0d38646-1] regionserver.HStore(310): Store=d78c68a1a90e6c0d85455c22a0d38646/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-15 21:11:38,137 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/data/default/testtb-testConsecutiveExports/1fb30bff8fea9087e0ff20afd85442f9 2023-07-15 21:11:38,138 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/data/default/testtb-testConsecutiveExports/1fb30bff8fea9087e0ff20afd85442f9 2023-07-15 21:11:38,138 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/data/default/testtb-testConsecutiveExports/d78c68a1a90e6c0d85455c22a0d38646 2023-07-15 21:11:38,139 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/data/default/testtb-testConsecutiveExports/d78c68a1a90e6c0d85455c22a0d38646 2023-07-15 21:11:38,140 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 1fb30bff8fea9087e0ff20afd85442f9 2023-07-15 21:11:38,141 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for d78c68a1a90e6c0d85455c22a0d38646 2023-07-15 21:11:38,142 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/data/default/testtb-testConsecutiveExports/1fb30bff8fea9087e0ff20afd85442f9/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-15 21:11:38,143 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 1fb30bff8fea9087e0ff20afd85442f9; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66482227, jitterRate=-0.009337618947029114}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-15 21:11:38,143 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 1fb30bff8fea9087e0ff20afd85442f9: 2023-07-15 21:11:38,143 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/data/default/testtb-testConsecutiveExports/d78c68a1a90e6c0d85455c22a0d38646/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-15 21:11:38,144 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testConsecutiveExports,1,1689455497697.1fb30bff8fea9087e0ff20afd85442f9., pid=46, masterSystemTime=1689455498123 2023-07-15 21:11:38,144 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened d78c68a1a90e6c0d85455c22a0d38646; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60125968, jitterRate=-0.10405325889587402}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-15 21:11:38,144 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for d78c68a1a90e6c0d85455c22a0d38646: 2023-07-15 21:11:38,145 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testConsecutiveExports,,1689455497697.d78c68a1a90e6c0d85455c22a0d38646., pid=45, masterSystemTime=1689455498122 2023-07-15 21:11:38,145 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testConsecutiveExports,1,1689455497697.1fb30bff8fea9087e0ff20afd85442f9. 2023-07-15 21:11:38,145 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testConsecutiveExports,1,1689455497697.1fb30bff8fea9087e0ff20afd85442f9. 2023-07-15 21:11:38,146 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=44 updating hbase:meta row=1fb30bff8fea9087e0ff20afd85442f9, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,39075,1689455452043 2023-07-15 21:11:38,146 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testConsecutiveExports,,1689455497697.d78c68a1a90e6c0d85455c22a0d38646. 2023-07-15 21:11:38,146 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testConsecutiveExports,,1689455497697.d78c68a1a90e6c0d85455c22a0d38646. 2023-07-15 21:11:38,146 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testConsecutiveExports,1,1689455497697.1fb30bff8fea9087e0ff20afd85442f9.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689455498146"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689455498146"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689455498146"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689455498146"}]},"ts":"1689455498146"} 2023-07-15 21:11:38,147 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=d78c68a1a90e6c0d85455c22a0d38646, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,39587,1689455451998 2023-07-15 21:11:38,147 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testConsecutiveExports,,1689455497697.d78c68a1a90e6c0d85455c22a0d38646.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689455498147"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689455498147"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689455498147"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689455498147"}]},"ts":"1689455498147"} 2023-07-15 21:11:38,150 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=46, resume processing ppid=44 2023-07-15 21:11:38,150 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=46, ppid=44, state=SUCCESS; OpenRegionProcedure 1fb30bff8fea9087e0ff20afd85442f9, server=jenkins-hbase4.apache.org,39075,1689455452043 in 182 msec 2023-07-15 21:11:38,151 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=45, resume processing ppid=43 2023-07-15 21:11:38,151 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=45, ppid=43, state=SUCCESS; OpenRegionProcedure d78c68a1a90e6c0d85455c22a0d38646, server=jenkins-hbase4.apache.org,39587,1689455451998 in 185 msec 2023-07-15 21:11:38,151 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=44, ppid=42, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=1fb30bff8fea9087e0ff20afd85442f9, ASSIGN in 346 msec 2023-07-15 21:11:38,153 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=43, resume processing ppid=42 2023-07-15 21:11:38,153 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=43, ppid=42, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=d78c68a1a90e6c0d85455c22a0d38646, ASSIGN in 347 msec 2023-07-15 21:11:38,154 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-15 21:11:38,154 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689455498154"}]},"ts":"1689455498154"} 2023-07-15 21:11:38,155 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=ENABLED in hbase:meta 2023-07-15 21:11:38,157 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_POST_OPERATION 2023-07-15 21:11:38,158 DEBUG [PEWorker-3] access.PermissionStorage(175): Writing permission with rowKey testtb-testConsecutiveExports jenkins: RWXCA 2023-07-15 21:11:38,159 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=39075] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-07-15 21:11:38,161 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): regionserver:37853-0x1016ad2d8bb0001, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 21:11:38,161 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): regionserver:39587-0x1016ad2d8bb0002, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 21:11:38,161 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): master:36465-0x1016ad2d8bb0000, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 21:11:38,161 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): regionserver:39075-0x1016ad2d8bb0003, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 21:11:38,162 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-07-15 21:11:38,162 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-07-15 21:11:38,162 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-07-15 21:11:38,163 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-07-15 21:11:38,164 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=42, state=SUCCESS; CreateTableProcedure table=testtb-testConsecutiveExports in 464 msec 2023-07-15 21:11:38,310 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36465] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-15 21:11:38,311 INFO [Listener at jenkins-hbase4.apache.org/41711] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testConsecutiveExports, procId: 42 completed 2023-07-15 21:11:38,313 DEBUG [Listener at jenkins-hbase4.apache.org/41711] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testConsecutiveExports 2023-07-15 21:11:38,313 DEBUG [Listener at jenkins-hbase4.apache.org/41711] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testConsecutiveExports,,1689455497697.d78c68a1a90e6c0d85455c22a0d38646. 2023-07-15 21:11:38,316 INFO [Listener at jenkins-hbase4.apache.org/41711] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-15 21:11:38,328 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36465] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-15 21:11:38,328 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36465] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689455498328 (current time:1689455498328). 2023-07-15 21:11:38,328 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36465] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-15 21:11:38,329 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36465] zookeeper.ReadOnlyZKClient(139): Connect 0x6caf061c to 127.0.0.1:50024 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-15 21:11:38,336 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36465] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7e7fb2a0, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-15 21:11:38,337 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36465] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-15 21:11:38,340 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:35914, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-15 21:11:38,341 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36465] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6caf061c to 127.0.0.1:50024 2023-07-15 21:11:38,341 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36465] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-15 21:11:38,341 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36465] zookeeper.ReadOnlyZKClient(139): Connect 0x2021cd4a to 127.0.0.1:50024 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-15 21:11:38,349 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36465] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@342aa0b4, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-15 21:11:38,350 DEBUG [hconnection-0x37c3fe23-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-15 21:11:38,353 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:35930, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-15 21:11:38,358 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36465] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2021cd4a to 127.0.0.1:50024 2023-07-15 21:11:38,358 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36465] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-15 21:11:38,358 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36465] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-07-15 21:11:38,359 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36465] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-15 21:11:38,359 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36465] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-15 21:11:38,362 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36465] procedure2.ProcedureExecutor(1029): Stored pid=47, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-15 21:11:38,363 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=47, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-15 21:11:38,364 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=47, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE; timeout=600000, timestamp=1689456098364 2023-07-15 21:11:38,364 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36465] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-15 21:11:38,364 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports 2023-07-15 21:11:38,365 DEBUG [Listener at jenkins-hbase4.apache.org/41711] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-15 21:11:38,365 DEBUG [Listener at jenkins-hbase4.apache.org/41711] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-15 21:11:38,366 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-15 21:11:38,367 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=47, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-15 21:11:38,368 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=47, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE in 6 msec 2023-07-15 21:11:38,369 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-15 21:11:38,370 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=48, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED; timeout=600000, timestamp=1689456098370 2023-07-15 21:11:38,391 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testConsecutiveExports 2023-07-15 21:11:38,391 INFO [(jenkins-hbase4.apache.org,36465,1689455450507)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testConsecutiveExports' 2023-07-15 21:11:38,391 DEBUG [(jenkins-hbase4.apache.org,36465,1689455450507)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 21:11:38,393 DEBUG [(jenkins-hbase4.apache.org,36465,1689455450507)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' 2023-07-15 21:11:38,393 DEBUG [(jenkins-hbase4.apache.org,36465,1689455450507)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testConsecutiveExports', kicking off acquire phase on members. 2023-07-15 21:11:38,462 DEBUG [(jenkins-hbase4.apache.org,36465,1689455450507)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36465-0x1016ad2d8bb0000, quorum=127.0.0.1:50024, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-15 21:11:38,462 DEBUG [(jenkins-hbase4.apache.org,36465,1689455450507)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-15 21:11:38,465 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): regionserver:39587-0x1016ad2d8bb0002, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 21:11:38,465 DEBUG [(jenkins-hbase4.apache.org,36465,1689455450507)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39587,1689455451998 2023-07-15 21:11:38,465 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 21:11:38,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 21:11:38,465 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): regionserver:37853-0x1016ad2d8bb0001, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 21:11:38,465 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 21:11:38,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 21:11:38,465 DEBUG [(jenkins-hbase4.apache.org,36465,1689455450507)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36465-0x1016ad2d8bb0000, quorum=127.0.0.1:50024, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39587,1689455451998 2023-07-15 21:11:38,465 DEBUG [(jenkins-hbase4.apache.org,36465,1689455450507)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39075,1689455452043 2023-07-15 21:11:38,466 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-15 21:11:38,466 DEBUG [Listener at jenkins-hbase4.apache.org/41711] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-15 21:11:38,466 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-15 21:11:38,467 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36465] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-15 21:11:38,467 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36465] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' is still in progress! 2023-07-15 21:11:38,468 DEBUG [Listener at jenkins-hbase4.apache.org/41711] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-15 21:11:38,469 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39587-0x1016ad2d8bb0002, quorum=127.0.0.1:50024, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-15 21:11:38,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-07-15 21:11:38,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-15 21:11:38,470 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37853-0x1016ad2d8bb0001, quorum=127.0.0.1:50024, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-15 21:11:38,470 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-15 21:11:38,470 DEBUG [(jenkins-hbase4.apache.org,36465,1689455450507)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36465-0x1016ad2d8bb0000, quorum=127.0.0.1:50024, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39075,1689455452043 2023-07-15 21:11:38,470 DEBUG [(jenkins-hbase4.apache.org,36465,1689455450507)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-15 21:11:38,470 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-07-15 21:11:38,470 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): regionserver:39075-0x1016ad2d8bb0003, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 21:11:38,471 DEBUG [member: 'jenkins-hbase4.apache.org,39587,1689455451998' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-15 21:11:38,471 DEBUG [member: 'jenkins-hbase4.apache.org,39587,1689455451998' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 21:11:38,471 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 21:11:38,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 21:11:38,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-07-15 21:11:38,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-15 21:11:38,472 DEBUG [member: 'jenkins-hbase4.apache.org,39587,1689455451998' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-15 21:11:38,472 DEBUG [member: 'jenkins-hbase4.apache.org,39587,1689455451998' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-07-15 21:11:38,472 DEBUG [member: 'jenkins-hbase4.apache.org,39587,1689455451998' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39587,1689455451998' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-07-15 21:11:38,472 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-15 21:11:38,473 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-07-15 21:11:38,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-15 21:11:38,473 DEBUG [member: 'jenkins-hbase4.apache.org,37853,1689455451932' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-15 21:11:38,473 DEBUG [member: 'jenkins-hbase4.apache.org,37853,1689455451932' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 21:11:38,475 DEBUG [member: 'jenkins-hbase4.apache.org,37853,1689455451932' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-15 21:11:38,475 DEBUG [member: 'jenkins-hbase4.apache.org,37853,1689455451932' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-07-15 21:11:38,475 DEBUG [member: 'jenkins-hbase4.apache.org,37853,1689455451932' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37853,1689455451932' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-07-15 21:11:38,476 DEBUG [member: 'jenkins-hbase4.apache.org,39587,1689455451998' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-15 21:11:38,477 DEBUG [member: 'jenkins-hbase4.apache.org,39587,1689455451998' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39587-0x1016ad2d8bb0002, quorum=127.0.0.1:50024, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-15 21:11:38,477 DEBUG [member: 'jenkins-hbase4.apache.org,39587,1689455451998' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-15 21:11:38,478 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): master:36465-0x1016ad2d8bb0000, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39587,1689455451998 2023-07-15 21:11:38,478 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39075-0x1016ad2d8bb0003, quorum=127.0.0.1:50024, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-15 21:11:38,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39587,1689455451998 2023-07-15 21:11:38,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 21:11:38,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 21:11:38,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 21:11:38,479 DEBUG [member: 'jenkins-hbase4.apache.org,37853,1689455451932' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-15 21:11:38,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-07-15 21:11:38,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-15 21:11:38,480 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-15 21:11:38,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 21:11:38,480 DEBUG [member: 'jenkins-hbase4.apache.org,37853,1689455451932' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37853-0x1016ad2d8bb0001, quorum=127.0.0.1:50024, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-15 21:11:38,480 DEBUG [member: 'jenkins-hbase4.apache.org,37853,1689455451932' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-15 21:11:38,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-15 21:11:38,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39587,1689455451998 2023-07-15 21:11:38,481 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37853,1689455451932 2023-07-15 21:11:38,481 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 21:11:38,482 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39587,1689455451998' joining acquired barrier for procedure 'emptySnaptb0-testConsecutiveExports' on coordinator 2023-07-15 21:11:38,482 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@36eac773[Count = 1] remaining members to acquire global barrier 2023-07-15 21:11:38,484 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-07-15 21:11:38,484 DEBUG [member: 'jenkins-hbase4.apache.org,39075,1689455452043' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-15 21:11:38,484 DEBUG [member: 'jenkins-hbase4.apache.org,39075,1689455452043' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 21:11:38,488 DEBUG [member: 'jenkins-hbase4.apache.org,39075,1689455452043' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-15 21:11:38,488 DEBUG [member: 'jenkins-hbase4.apache.org,39075,1689455452043' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-07-15 21:11:38,488 DEBUG [member: 'jenkins-hbase4.apache.org,39075,1689455452043' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39075,1689455452043' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-07-15 21:11:38,490 DEBUG [member: 'jenkins-hbase4.apache.org,39075,1689455452043' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-15 21:11:38,490 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): master:36465-0x1016ad2d8bb0000, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39075,1689455452043 2023-07-15 21:11:38,490 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39075,1689455452043 2023-07-15 21:11:38,490 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 21:11:38,490 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 21:11:38,491 DEBUG [member: 'jenkins-hbase4.apache.org,39075,1689455452043' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39075-0x1016ad2d8bb0003, quorum=127.0.0.1:50024, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-15 21:11:38,491 DEBUG [member: 'jenkins-hbase4.apache.org,39075,1689455452043' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-15 21:11:38,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 21:11:38,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 21:11:38,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-15 21:11:38,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39075,1689455452043 2023-07-15 21:11:38,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39587,1689455451998 2023-07-15 21:11:38,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37853,1689455451932 2023-07-15 21:11:38,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 21:11:38,493 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39075,1689455452043' joining acquired barrier for procedure 'emptySnaptb0-testConsecutiveExports' on coordinator 2023-07-15 21:11:38,493 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@36eac773[Count = 0] remaining members to acquire global barrier 2023-07-15 21:11:38,493 DEBUG [(jenkins-hbase4.apache.org,36465,1689455450507)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testConsecutiveExports' starting 'in-barrier' execution. 2023-07-15 21:11:38,493 DEBUG [(jenkins-hbase4.apache.org,36465,1689455450507)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-15 21:11:38,495 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): regionserver:39587-0x1016ad2d8bb0002, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-15 21:11:38,495 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): regionserver:37853-0x1016ad2d8bb0001, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-15 21:11:38,495 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-15 21:11:38,495 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): regionserver:39075-0x1016ad2d8bb0003, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-15 21:11:38,495 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-15 21:11:38,495 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-15 21:11:38,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-15 21:11:38,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-15 21:11:38,496 DEBUG [member: 'jenkins-hbase4.apache.org,39075,1689455452043' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-15 21:11:38,496 DEBUG [member: 'jenkins-hbase4.apache.org,39587,1689455451998' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-15 21:11:38,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-15 21:11:38,496 DEBUG [member: 'jenkins-hbase4.apache.org,39075,1689455452043' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-15 21:11:38,496 DEBUG [member: 'jenkins-hbase4.apache.org,39075,1689455452043' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-15 21:11:38,496 DEBUG [(jenkins-hbase4.apache.org,36465,1689455450507)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36465-0x1016ad2d8bb0000, quorum=127.0.0.1:50024, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39587,1689455451998 2023-07-15 21:11:38,496 DEBUG [rs(jenkins-hbase4.apache.org,39075,1689455452043)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,1,1689455497697.1fb30bff8fea9087e0ff20afd85442f9. 2023-07-15 21:11:38,496 DEBUG [member: 'jenkins-hbase4.apache.org,39587,1689455451998' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-15 21:11:38,496 DEBUG [rs(jenkins-hbase4.apache.org,39075,1689455452043)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,1,1689455497697.1fb30bff8fea9087e0ff20afd85442f9. started... 2023-07-15 21:11:38,496 DEBUG [rs(jenkins-hbase4.apache.org,39587,1689455451998)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,,1689455497697.d78c68a1a90e6c0d85455c22a0d38646. 2023-07-15 21:11:38,496 DEBUG [member: 'jenkins-hbase4.apache.org,37853,1689455451932' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-15 21:11:38,496 DEBUG [rs(jenkins-hbase4.apache.org,39587,1689455451998)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,,1689455497697.d78c68a1a90e6c0d85455c22a0d38646. started... 2023-07-15 21:11:38,496 DEBUG [member: 'jenkins-hbase4.apache.org,39587,1689455451998' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-15 21:11:38,496 DEBUG [member: 'jenkins-hbase4.apache.org,37853,1689455451932' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-07-15 21:11:38,496 DEBUG [(jenkins-hbase4.apache.org,36465,1689455450507)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36465-0x1016ad2d8bb0000, quorum=127.0.0.1:50024, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39075,1689455452043 2023-07-15 21:11:38,496 DEBUG [(jenkins-hbase4.apache.org,36465,1689455450507)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-15 21:11:38,496 DEBUG [member: 'jenkins-hbase4.apache.org,37853,1689455451932' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,37853,1689455451932' in zk 2023-07-15 21:11:38,496 DEBUG [rs(jenkins-hbase4.apache.org,39587,1689455451998)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for d78c68a1a90e6c0d85455c22a0d38646: 2023-07-15 21:11:38,498 DEBUG [rs(jenkins-hbase4.apache.org,39587,1689455451998)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,,1689455497697.d78c68a1a90e6c0d85455c22a0d38646.' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-07-15 21:11:38,498 DEBUG [rs(jenkins-hbase4.apache.org,39075,1689455452043)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 1fb30bff8fea9087e0ff20afd85442f9: 2023-07-15 21:11:38,498 DEBUG [rs(jenkins-hbase4.apache.org,39587,1689455451998)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-15 21:11:38,498 DEBUG [rs(jenkins-hbase4.apache.org,39587,1689455451998)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-15 21:11:38,498 DEBUG [rs(jenkins-hbase4.apache.org,39075,1689455452043)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,1,1689455497697.1fb30bff8fea9087e0ff20afd85442f9.' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-07-15 21:11:38,500 DEBUG [rs(jenkins-hbase4.apache.org,39075,1689455452043)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-15 21:11:38,500 DEBUG [rs(jenkins-hbase4.apache.org,39075,1689455452043)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-15 21:11:38,503 DEBUG [member: 'jenkins-hbase4.apache.org,37853,1689455451932' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-07-15 21:11:38,503 DEBUG [member: 'jenkins-hbase4.apache.org,37853,1689455451932' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 21:11:38,503 DEBUG [member: 'jenkins-hbase4.apache.org,37853,1689455451932' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-07-15 21:11:38,523 DEBUG [rs(jenkins-hbase4.apache.org,39075,1689455452043)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,1,1689455497697.1fb30bff8fea9087e0ff20afd85442f9. completed. 2023-07-15 21:11:38,523 DEBUG [rs(jenkins-hbase4.apache.org,39075,1689455452043)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,1,1689455497697.1fb30bff8fea9087e0ff20afd85442f9. 2023-07-15 21:11:38,523 DEBUG [member: 'jenkins-hbase4.apache.org,39075,1689455452043' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-15 21:11:38,523 DEBUG [member: 'jenkins-hbase4.apache.org,39075,1689455452043' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-15 21:11:38,523 DEBUG [member: 'jenkins-hbase4.apache.org,39075,1689455452043' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,39075,1689455452043 2023-07-15 21:11:38,523 DEBUG [member: 'jenkins-hbase4.apache.org,39075,1689455452043' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-07-15 21:11:38,523 DEBUG [member: 'jenkins-hbase4.apache.org,39075,1689455452043' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,39075,1689455452043' in zk 2023-07-15 21:11:38,525 DEBUG [member: 'jenkins-hbase4.apache.org,39075,1689455452043' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-07-15 21:11:38,525 DEBUG [member: 'jenkins-hbase4.apache.org,39075,1689455452043' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 21:11:38,525 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): master:36465-0x1016ad2d8bb0000, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39075,1689455452043 2023-07-15 21:11:38,525 DEBUG [member: 'jenkins-hbase4.apache.org,39075,1689455452043' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-07-15 21:11:38,527 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39075,1689455452043 2023-07-15 21:11:38,527 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 21:11:38,527 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 21:11:38,527 DEBUG [rs(jenkins-hbase4.apache.org,39587,1689455451998)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,,1689455497697.d78c68a1a90e6c0d85455c22a0d38646. completed. 2023-07-15 21:11:38,527 DEBUG [rs(jenkins-hbase4.apache.org,39587,1689455451998)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,,1689455497697.d78c68a1a90e6c0d85455c22a0d38646. 2023-07-15 21:11:38,527 DEBUG [member: 'jenkins-hbase4.apache.org,39587,1689455451998' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-15 21:11:38,527 DEBUG [member: 'jenkins-hbase4.apache.org,39587,1689455451998' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-15 21:11:38,527 DEBUG [member: 'jenkins-hbase4.apache.org,39587,1689455451998' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,39587,1689455451998 2023-07-15 21:11:38,527 DEBUG [member: 'jenkins-hbase4.apache.org,39587,1689455451998' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-07-15 21:11:38,527 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 21:11:38,527 DEBUG [member: 'jenkins-hbase4.apache.org,39587,1689455451998' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,39587,1689455451998' in zk 2023-07-15 21:11:38,528 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 21:11:38,528 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-15 21:11:38,529 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): master:36465-0x1016ad2d8bb0000, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39587,1689455451998 2023-07-15 21:11:38,529 DEBUG [member: 'jenkins-hbase4.apache.org,39587,1689455451998' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-07-15 21:11:38,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39075,1689455452043 2023-07-15 21:11:38,529 DEBUG [member: 'jenkins-hbase4.apache.org,39587,1689455451998' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 21:11:38,529 DEBUG [member: 'jenkins-hbase4.apache.org,39587,1689455451998' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-07-15 21:11:38,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39587,1689455451998 2023-07-15 21:11:38,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37853,1689455451932 2023-07-15 21:11:38,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 21:11:38,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-15 21:11:38,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39075,1689455452043 2023-07-15 21:11:38,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39587,1689455451998 2023-07-15 21:11:38,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37853,1689455451932 2023-07-15 21:11:38,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,39075,1689455452043': 2023-07-15 21:11:38,534 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39075,1689455452043' released barrier for procedure'emptySnaptb0-testConsecutiveExports', counting down latch. Waiting for 1 more 2023-07-15 21:11:38,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39587,1689455451998 2023-07-15 21:11:38,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 21:11:38,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 21:11:38,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 21:11:38,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 21:11:38,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-15 21:11:38,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39075,1689455452043 2023-07-15 21:11:38,536 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39587,1689455451998 2023-07-15 21:11:38,536 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37853,1689455451932 2023-07-15 21:11:38,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 21:11:38,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-15 21:11:38,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39075,1689455452043 2023-07-15 21:11:38,538 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39587,1689455451998 2023-07-15 21:11:38,538 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37853,1689455451932 2023-07-15 21:11:38,539 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,39587,1689455451998': 2023-07-15 21:11:38,539 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39587,1689455451998' released barrier for procedure'emptySnaptb0-testConsecutiveExports', counting down latch. Waiting for 0 more 2023-07-15 21:11:38,539 INFO [(jenkins-hbase4.apache.org,36465,1689455450507)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testConsecutiveExports' execution completed 2023-07-15 21:11:38,539 DEBUG [(jenkins-hbase4.apache.org,36465,1689455450507)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-15 21:11:38,539 DEBUG [(jenkins-hbase4.apache.org,36465,1689455450507)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-15 21:11:38,539 DEBUG [(jenkins-hbase4.apache.org,36465,1689455450507)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testConsecutiveExports 2023-07-15 21:11:38,539 INFO [(jenkins-hbase4.apache.org,36465,1689455450507)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testConsecutiveExportsincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-15 21:11:38,541 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): regionserver:37853-0x1016ad2d8bb0001, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-15 21:11:38,541 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): regionserver:39587-0x1016ad2d8bb0002, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-15 21:11:38,541 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): regionserver:37853-0x1016ad2d8bb0001, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 21:11:38,541 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): regionserver:39587-0x1016ad2d8bb0002, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 21:11:38,541 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-15 21:11:38,541 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-15 21:11:38,541 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-15 21:11:38,541 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): master:36465-0x1016ad2d8bb0000, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-15 21:11:38,541 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-15 21:11:38,541 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-15 21:11:38,541 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): regionserver:39075-0x1016ad2d8bb0003, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-15 21:11:38,541 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 21:11:38,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 21:11:38,542 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-15 21:11:38,542 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 21:11:38,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 21:11:38,542 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): regionserver:39075-0x1016ad2d8bb0003, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 21:11:38,542 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 21:11:38,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 21:11:38,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-15 21:11:38,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-15 21:11:38,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-15 21:11:38,543 DEBUG [(jenkins-hbase4.apache.org,36465,1689455450507)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36465-0x1016ad2d8bb0000, quorum=127.0.0.1:50024, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39075,1689455452043 2023-07-15 21:11:38,543 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 21:11:38,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 21:11:38,543 DEBUG [(jenkins-hbase4.apache.org,36465,1689455450507)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36465-0x1016ad2d8bb0000, quorum=127.0.0.1:50024, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39587,1689455451998 2023-07-15 21:11:38,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 21:11:38,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-15 21:11:38,544 DEBUG [(jenkins-hbase4.apache.org,36465,1689455450507)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36465-0x1016ad2d8bb0000, quorum=127.0.0.1:50024, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37853,1689455451932 2023-07-15 21:11:38,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-15 21:11:38,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 21:11:38,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-15 21:11:38,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39075,1689455452043 2023-07-15 21:11:38,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39587,1689455451998 2023-07-15 21:11:38,546 DEBUG [(jenkins-hbase4.apache.org,36465,1689455450507)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36465-0x1016ad2d8bb0000, quorum=127.0.0.1:50024, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39075,1689455452043 2023-07-15 21:11:38,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37853,1689455451932 2023-07-15 21:11:38,546 DEBUG [(jenkins-hbase4.apache.org,36465,1689455450507)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36465-0x1016ad2d8bb0000, quorum=127.0.0.1:50024, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39587,1689455451998 2023-07-15 21:11:38,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 21:11:38,547 DEBUG [(jenkins-hbase4.apache.org,36465,1689455450507)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36465-0x1016ad2d8bb0000, quorum=127.0.0.1:50024, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37853,1689455451932 2023-07-15 21:11:38,547 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-15 21:11:38,547 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39075,1689455452043 2023-07-15 21:11:38,548 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39587,1689455451998 2023-07-15 21:11:38,548 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37853,1689455451932 2023-07-15 21:11:38,554 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): regionserver:39075-0x1016ad2d8bb0003, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 21:11:38,554 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): regionserver:37853-0x1016ad2d8bb0001, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 21:11:38,554 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): regionserver:37853-0x1016ad2d8bb0001, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 21:11:38,554 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): regionserver:39587-0x1016ad2d8bb0002, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 21:11:38,554 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 21:11:38,554 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 21:11:38,554 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 21:11:38,554 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): regionserver:39075-0x1016ad2d8bb0003, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 21:11:38,555 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testConsecutiveExports 2023-07-15 21:11:38,555 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testConsecutiveExports 2023-07-15 21:11:38,555 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => c7b48a2e62736c517f8bfa7d64fc37ac, NAME => 'testtb-testConsecutiveExports,.mob,0.c7b48a2e62736c517f8bfa7d64fc37ac.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-07-15 21:11:38,555 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-15 21:11:38,555 DEBUG [(jenkins-hbase4.apache.org,36465,1689455450507)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 21:11:38,554 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 21:11:38,554 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): regionserver:39587-0x1016ad2d8bb0002, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 21:11:38,557 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 21:11:38,557 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-07-15 21:11:38,554 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 21:11:38,554 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): master:36465-0x1016ad2d8bb0000, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37853,1689455451932 2023-07-15 21:11:38,558 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): master:36465-0x1016ad2d8bb0000, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-15 21:11:38,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 21:11:38,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 21:11:38,558 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): master:36465-0x1016ad2d8bb0000, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39587,1689455451998 2023-07-15 21:11:38,558 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 21:11:38,558 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): master:36465-0x1016ad2d8bb0000, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39075,1689455452043 2023-07-15 21:11:38,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 21:11:38,558 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): master:36465-0x1016ad2d8bb0000, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-15 21:11:38,558 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): master:36465-0x1016ad2d8bb0000, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37853,1689455451932 2023-07-15 21:11:38,558 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): master:36465-0x1016ad2d8bb0000, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-15 21:11:38,558 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): master:36465-0x1016ad2d8bb0000, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39587,1689455451998 2023-07-15 21:11:38,558 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): master:36465-0x1016ad2d8bb0000, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39075,1689455452043 2023-07-15 21:11:38,558 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): master:36465-0x1016ad2d8bb0000, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-15 21:11:38,558 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): master:36465-0x1016ad2d8bb0000, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-15 21:11:38,559 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 21:11:38,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 21:11:38,573 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testConsecutiveExports 2023-07-15 21:11:38,574 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-07-15 21:11:38,611 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports to hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/.hbase-snapshot/emptySnaptb0-testConsecutiveExports 2023-07-15 21:11:38,650 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed 2023-07-15 21:11:38,651 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-07-15 21:11:38,651 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-07-15 21:11:38,651 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports at 1689455498364Completed referencing HFiles for the mob region of table: testtb-testConsecutiveExports at 1689455498573 (+209 ms)Consolidate snapshot: emptySnaptb0-testConsecutiveExports at 1689455498573Loading Region manifests for emptySnaptb0-testConsecutiveExports at 1689455498573Writing data manifest for emptySnaptb0-testConsecutiveExports at 1689455498587 (+14 ms)Verifying snapshot: emptySnaptb0-testConsecutiveExports at 1689455498604 (+17 ms)Snapshot emptySnaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed at 1689455498650 (+46 ms) 2023-07-15 21:11:38,657 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=48, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-15 21:11:38,659 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=48, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED in 292 msec 2023-07-15 21:11:38,668 DEBUG [Listener at jenkins-hbase4.apache.org/41711] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-15 21:11:38,669 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36465] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-15 21:11:38,669 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36465] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-15 21:11:38,676 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39587] regionserver.HRegion(8805): writing data to region testtb-testConsecutiveExports,,1689455497697.d78c68a1a90e6c0d85455c22a0d38646. with WAL disabled. Data may be lost in the event of a crash. 2023-07-15 21:11:38,677 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39075] regionserver.HRegion(8805): writing data to region testtb-testConsecutiveExports,1,1689455497697.1fb30bff8fea9087e0ff20afd85442f9. with WAL disabled. Data may be lost in the event of a crash. 2023-07-15 21:11:38,680 DEBUG [Listener at jenkins-hbase4.apache.org/41711] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testConsecutiveExports 2023-07-15 21:11:38,680 DEBUG [Listener at jenkins-hbase4.apache.org/41711] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testConsecutiveExports,,1689455497697.d78c68a1a90e6c0d85455c22a0d38646. 2023-07-15 21:11:38,681 INFO [Listener at jenkins-hbase4.apache.org/41711] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-15 21:11:38,694 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36465] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-15 21:11:38,694 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36465] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689455498694 (current time:1689455498694). 2023-07-15 21:11:38,694 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36465] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-15 21:11:38,695 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36465] zookeeper.ReadOnlyZKClient(139): Connect 0x04ed9c6f to 127.0.0.1:50024 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-15 21:11:38,714 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36465] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2d849506, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-15 21:11:38,716 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36465] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-15 21:11:38,717 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:35944, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-15 21:11:38,719 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36465] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x04ed9c6f to 127.0.0.1:50024 2023-07-15 21:11:38,719 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36465] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-15 21:11:38,719 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36465] zookeeper.ReadOnlyZKClient(139): Connect 0x534357ba to 127.0.0.1:50024 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-15 21:11:38,730 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36465] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3ba5a759, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-15 21:11:38,732 DEBUG [hconnection-0x3280298e-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-15 21:11:38,734 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:35954, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-15 21:11:38,739 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36465] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x534357ba to 127.0.0.1:50024 2023-07-15 21:11:38,739 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36465] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-15 21:11:38,739 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36465] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-07-15 21:11:38,740 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36465] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-15 21:11:38,740 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36465] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-15 21:11:38,743 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36465] procedure2.ProcedureExecutor(1029): Stored pid=49, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-15 21:11:38,744 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=49, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-15 21:11:38,745 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=49, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE; timeout=600000, timestamp=1689456098745 2023-07-15 21:11:38,745 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports 2023-07-15 21:11:38,745 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36465] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-15 21:11:38,746 DEBUG [Listener at jenkins-hbase4.apache.org/41711] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-15 21:11:38,746 DEBUG [Listener at jenkins-hbase4.apache.org/41711] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-15 21:11:38,747 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=49, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-15 21:11:38,747 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=50, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-15 21:11:38,749 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=49, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE in 6 msec 2023-07-15 21:11:38,750 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=50, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-15 21:11:38,751 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=50, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED; timeout=600000, timestamp=1689456098751 2023-07-15 21:11:38,763 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testConsecutiveExports 2023-07-15 21:11:38,764 INFO [(jenkins-hbase4.apache.org,36465,1689455450507)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testConsecutiveExports' 2023-07-15 21:11:38,764 DEBUG [(jenkins-hbase4.apache.org,36465,1689455450507)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 21:11:38,765 DEBUG [(jenkins-hbase4.apache.org,36465,1689455450507)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testConsecutiveExports' starting 'acquire' 2023-07-15 21:11:38,765 DEBUG [(jenkins-hbase4.apache.org,36465,1689455450507)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testConsecutiveExports', kicking off acquire phase on members. 2023-07-15 21:11:38,765 DEBUG [(jenkins-hbase4.apache.org,36465,1689455450507)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36465-0x1016ad2d8bb0000, quorum=127.0.0.1:50024, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-15 21:11:38,765 DEBUG [(jenkins-hbase4.apache.org,36465,1689455450507)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-15 21:11:38,791 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): regionserver:39587-0x1016ad2d8bb0002, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 21:11:38,791 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): regionserver:39075-0x1016ad2d8bb0003, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 21:11:38,791 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 21:11:38,791 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 21:11:38,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 21:11:38,791 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): regionserver:37853-0x1016ad2d8bb0001, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 21:11:38,791 DEBUG [(jenkins-hbase4.apache.org,36465,1689455450507)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39587,1689455451998 2023-07-15 21:11:38,791 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 21:11:38,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 21:11:38,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 21:11:38,792 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-15 21:11:38,792 DEBUG [(jenkins-hbase4.apache.org,36465,1689455450507)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36465-0x1016ad2d8bb0000, quorum=127.0.0.1:50024, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39587,1689455451998 2023-07-15 21:11:38,792 DEBUG [(jenkins-hbase4.apache.org,36465,1689455450507)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39075,1689455452043 2023-07-15 21:11:38,792 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-15 21:11:38,792 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-15 21:11:38,792 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39075-0x1016ad2d8bb0003, quorum=127.0.0.1:50024, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-15 21:11:38,792 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39587-0x1016ad2d8bb0002, quorum=127.0.0.1:50024, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-15 21:11:38,792 DEBUG [(jenkins-hbase4.apache.org,36465,1689455450507)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36465-0x1016ad2d8bb0000, quorum=127.0.0.1:50024, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39075,1689455452043 2023-07-15 21:11:38,792 DEBUG [(jenkins-hbase4.apache.org,36465,1689455450507)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-15 21:11:38,792 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37853-0x1016ad2d8bb0001, quorum=127.0.0.1:50024, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-15 21:11:38,792 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-07-15 21:11:38,792 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-15 21:11:38,793 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-07-15 21:11:38,793 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-15 21:11:38,793 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-15 21:11:38,793 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-07-15 21:11:38,793 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-15 21:11:38,793 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-15 21:11:38,793 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-15 21:11:38,793 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-07-15 21:11:38,793 DEBUG [member: 'jenkins-hbase4.apache.org,39075,1689455452043' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-15 21:11:38,793 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-07-15 21:11:38,793 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-07-15 21:11:38,793 DEBUG [member: 'jenkins-hbase4.apache.org,39075,1689455452043' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 21:11:38,793 DEBUG [member: 'jenkins-hbase4.apache.org,37853,1689455451932' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-15 21:11:38,795 DEBUG [member: 'jenkins-hbase4.apache.org,37853,1689455451932' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 21:11:38,793 DEBUG [member: 'jenkins-hbase4.apache.org,39587,1689455451998' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-15 21:11:38,796 DEBUG [member: 'jenkins-hbase4.apache.org,37853,1689455451932' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-15 21:11:38,795 DEBUG [member: 'jenkins-hbase4.apache.org,39075,1689455452043' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-15 21:11:38,796 DEBUG [member: 'jenkins-hbase4.apache.org,37853,1689455451932' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-07-15 21:11:38,796 DEBUG [member: 'jenkins-hbase4.apache.org,39587,1689455451998' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 21:11:38,796 DEBUG [member: 'jenkins-hbase4.apache.org,37853,1689455451932' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37853,1689455451932' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-07-15 21:11:38,796 DEBUG [member: 'jenkins-hbase4.apache.org,39075,1689455452043' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-07-15 21:11:38,797 DEBUG [member: 'jenkins-hbase4.apache.org,39587,1689455451998' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-15 21:11:38,797 DEBUG [member: 'jenkins-hbase4.apache.org,39587,1689455451998' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-07-15 21:11:38,797 DEBUG [member: 'jenkins-hbase4.apache.org,39587,1689455451998' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39587,1689455451998' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-07-15 21:11:38,797 DEBUG [member: 'jenkins-hbase4.apache.org,39075,1689455452043' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39075,1689455452043' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-07-15 21:11:38,814 DEBUG [member: 'jenkins-hbase4.apache.org,37853,1689455451932' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-15 21:11:38,846 DEBUG [Listener at jenkins-hbase4.apache.org/41711] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-15 21:11:38,847 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36465] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-15 21:11:38,847 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36465] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' is still in progress! 2023-07-15 21:11:38,848 DEBUG [Listener at jenkins-hbase4.apache.org/41711] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-15 21:11:38,852 DEBUG [member: 'jenkins-hbase4.apache.org,39587,1689455451998' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-15 21:11:38,852 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): master:36465-0x1016ad2d8bb0000, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39587,1689455451998 2023-07-15 21:11:38,852 DEBUG [member: 'jenkins-hbase4.apache.org,37853,1689455451932' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37853-0x1016ad2d8bb0001, quorum=127.0.0.1:50024, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-15 21:11:38,852 DEBUG [member: 'jenkins-hbase4.apache.org,37853,1689455451932' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-15 21:11:38,852 DEBUG [member: 'jenkins-hbase4.apache.org,39075,1689455452043' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-15 21:11:38,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39587,1689455451998 2023-07-15 21:11:38,853 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 21:11:38,853 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 21:11:38,852 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): master:36465-0x1016ad2d8bb0000, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39075,1689455452043 2023-07-15 21:11:38,853 DEBUG [member: 'jenkins-hbase4.apache.org,39587,1689455451998' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39587-0x1016ad2d8bb0002, quorum=127.0.0.1:50024, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-15 21:11:38,853 DEBUG [member: 'jenkins-hbase4.apache.org,39587,1689455451998' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-15 21:11:38,853 DEBUG [member: 'jenkins-hbase4.apache.org,39075,1689455452043' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39075-0x1016ad2d8bb0003, quorum=127.0.0.1:50024, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-15 21:11:38,853 DEBUG [member: 'jenkins-hbase4.apache.org,39075,1689455452043' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-15 21:11:38,853 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 21:11:38,853 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 21:11:38,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-15 21:11:38,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39075,1689455452043 2023-07-15 21:11:38,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39587,1689455451998 2023-07-15 21:11:38,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37853,1689455451932 2023-07-15 21:11:38,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 21:11:38,855 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39587,1689455451998' joining acquired barrier for procedure 'snaptb0-testConsecutiveExports' on coordinator 2023-07-15 21:11:38,855 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5b6e0d2b[Count = 1] remaining members to acquire global barrier 2023-07-15 21:11:38,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39075,1689455452043 2023-07-15 21:11:38,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 21:11:38,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 21:11:38,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 21:11:38,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 21:11:38,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-15 21:11:38,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39075,1689455452043 2023-07-15 21:11:38,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39587,1689455451998 2023-07-15 21:11:38,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37853,1689455451932 2023-07-15 21:11:38,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 21:11:38,857 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39075,1689455452043' joining acquired barrier for procedure 'snaptb0-testConsecutiveExports' on coordinator 2023-07-15 21:11:38,857 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5b6e0d2b[Count = 0] remaining members to acquire global barrier 2023-07-15 21:11:38,857 DEBUG [(jenkins-hbase4.apache.org,36465,1689455450507)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testConsecutiveExports' starting 'in-barrier' execution. 2023-07-15 21:11:38,857 DEBUG [(jenkins-hbase4.apache.org,36465,1689455450507)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-15 21:11:38,891 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): regionserver:39075-0x1016ad2d8bb0003, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-15 21:11:38,891 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): regionserver:39587-0x1016ad2d8bb0002, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-15 21:11:38,891 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-15 21:11:38,891 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-15 21:11:38,891 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): regionserver:37853-0x1016ad2d8bb0001, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-15 21:11:38,891 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-15 21:11:38,891 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-15 21:11:38,891 DEBUG [member: 'jenkins-hbase4.apache.org,39587,1689455451998' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-15 21:11:38,891 DEBUG [(jenkins-hbase4.apache.org,36465,1689455450507)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36465-0x1016ad2d8bb0000, quorum=127.0.0.1:50024, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39587,1689455451998 2023-07-15 21:11:38,891 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-15 21:11:38,891 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-15 21:11:38,891 DEBUG [member: 'jenkins-hbase4.apache.org,39075,1689455452043' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-15 21:11:38,891 DEBUG [member: 'jenkins-hbase4.apache.org,37853,1689455451932' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-15 21:11:38,891 DEBUG [rs(jenkins-hbase4.apache.org,39587,1689455451998)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,,1689455497697.d78c68a1a90e6c0d85455c22a0d38646. 2023-07-15 21:11:38,891 DEBUG [member: 'jenkins-hbase4.apache.org,37853,1689455451932' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-07-15 21:11:38,891 DEBUG [rs(jenkins-hbase4.apache.org,39587,1689455451998)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,,1689455497697.d78c68a1a90e6c0d85455c22a0d38646. started... 2023-07-15 21:11:38,891 DEBUG [member: 'jenkins-hbase4.apache.org,39587,1689455451998' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-15 21:11:38,892 DEBUG [(jenkins-hbase4.apache.org,36465,1689455450507)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36465-0x1016ad2d8bb0000, quorum=127.0.0.1:50024, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39075,1689455452043 2023-07-15 21:11:38,892 DEBUG [member: 'jenkins-hbase4.apache.org,39587,1689455451998' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-15 21:11:38,892 DEBUG [rs(jenkins-hbase4.apache.org,39075,1689455452043)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,1,1689455497697.1fb30bff8fea9087e0ff20afd85442f9. 2023-07-15 21:11:38,891 DEBUG [member: 'jenkins-hbase4.apache.org,37853,1689455451932' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,37853,1689455451932' in zk 2023-07-15 21:11:38,891 DEBUG [member: 'jenkins-hbase4.apache.org,39075,1689455452043' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-15 21:11:38,892 DEBUG [member: 'jenkins-hbase4.apache.org,39075,1689455452043' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-15 21:11:38,892 DEBUG [rs(jenkins-hbase4.apache.org,39075,1689455452043)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,1,1689455497697.1fb30bff8fea9087e0ff20afd85442f9. started... 2023-07-15 21:11:38,892 INFO [rs(jenkins-hbase4.apache.org,39587,1689455451998)-snapshot-pool-0] regionserver.HRegion(2745): Flushing d78c68a1a90e6c0d85455c22a0d38646 1/1 column families, dataSize=400 B heapSize=1.09 KB 2023-07-15 21:11:38,892 DEBUG [(jenkins-hbase4.apache.org,36465,1689455450507)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-15 21:11:38,892 INFO [rs(jenkins-hbase4.apache.org,39075,1689455452043)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 1fb30bff8fea9087e0ff20afd85442f9 1/1 column families, dataSize=2.87 KB heapSize=6.44 KB 2023-07-15 21:11:38,912 INFO [rs(jenkins-hbase4.apache.org,39587,1689455451998)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230715b825f6f68ac64a9da9970d0a4335d4ae to hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e20230715b825f6f68ac64a9da9970d0a4335d4ae 2023-07-15 21:11:38,913 INFO [rs(jenkins-hbase4.apache.org,39075,1689455452043)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202307151c4021e2d0db4f16aeb85798885912f5 to hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b202307151c4021e2d0db4f16aeb85798885912f5 2023-07-15 21:11:38,919 INFO [rs(jenkins-hbase4.apache.org,39587,1689455451998)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=400, hasBloomFilter=true, into tmp file hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/data/default/testtb-testConsecutiveExports/d78c68a1a90e6c0d85455c22a0d38646/.tmp/cf/b9340caf88a140ab88ed6ad7339cd128 2023-07-15 21:11:38,920 INFO [rs(jenkins-hbase4.apache.org,39075,1689455452043)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=2.9 K, hasBloomFilter=true, into tmp file hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/data/default/testtb-testConsecutiveExports/1fb30bff8fea9087e0ff20afd85442f9/.tmp/cf/06c88f302fce487b98ba154fe3ac95d3 2023-07-15 21:11:38,921 DEBUG [member: 'jenkins-hbase4.apache.org,37853,1689455451932' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-07-15 21:11:38,922 DEBUG [member: 'jenkins-hbase4.apache.org,37853,1689455451932' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 21:11:38,922 DEBUG [member: 'jenkins-hbase4.apache.org,37853,1689455451932' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-07-15 21:11:38,927 DEBUG [rs(jenkins-hbase4.apache.org,39075,1689455452043)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/data/default/testtb-testConsecutiveExports/1fb30bff8fea9087e0ff20afd85442f9/.tmp/cf/06c88f302fce487b98ba154fe3ac95d3 as hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/data/default/testtb-testConsecutiveExports/1fb30bff8fea9087e0ff20afd85442f9/cf/06c88f302fce487b98ba154fe3ac95d3 2023-07-15 21:11:38,927 DEBUG [rs(jenkins-hbase4.apache.org,39587,1689455451998)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/data/default/testtb-testConsecutiveExports/d78c68a1a90e6c0d85455c22a0d38646/.tmp/cf/b9340caf88a140ab88ed6ad7339cd128 as hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/data/default/testtb-testConsecutiveExports/d78c68a1a90e6c0d85455c22a0d38646/cf/b9340caf88a140ab88ed6ad7339cd128 2023-07-15 21:11:38,932 INFO [rs(jenkins-hbase4.apache.org,39075,1689455452043)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/data/default/testtb-testConsecutiveExports/1fb30bff8fea9087e0ff20afd85442f9/cf/06c88f302fce487b98ba154fe3ac95d3, entries=44, sequenceid=6, filesize=12.2 K 2023-07-15 21:11:38,933 INFO [rs(jenkins-hbase4.apache.org,39075,1689455452043)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~2.87 KB/2936, heapSize ~6.42 KB/6576, currentSize=0 B/0 for 1fb30bff8fea9087e0ff20afd85442f9 in 41ms, sequenceid=6, compaction requested=false 2023-07-15 21:11:38,933 DEBUG [rs(jenkins-hbase4.apache.org,39075,1689455452043)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testConsecutiveExports' 2023-07-15 21:11:38,933 DEBUG [rs(jenkins-hbase4.apache.org,39075,1689455452043)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 1fb30bff8fea9087e0ff20afd85442f9: 2023-07-15 21:11:38,933 DEBUG [rs(jenkins-hbase4.apache.org,39075,1689455452043)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,1,1689455497697.1fb30bff8fea9087e0ff20afd85442f9.' region-info for snapshot=snaptb0-testConsecutiveExports 2023-07-15 21:11:38,933 DEBUG [rs(jenkins-hbase4.apache.org,39075,1689455452043)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-15 21:11:38,934 DEBUG [rs(jenkins-hbase4.apache.org,39075,1689455452043)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/data/default/testtb-testConsecutiveExports/1fb30bff8fea9087e0ff20afd85442f9/cf/06c88f302fce487b98ba154fe3ac95d3] hfiles 2023-07-15 21:11:38,934 DEBUG [rs(jenkins-hbase4.apache.org,39075,1689455452043)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/data/default/testtb-testConsecutiveExports/1fb30bff8fea9087e0ff20afd85442f9/cf/06c88f302fce487b98ba154fe3ac95d3 for snapshot=snaptb0-testConsecutiveExports 2023-07-15 21:11:38,939 INFO [rs(jenkins-hbase4.apache.org,39587,1689455451998)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/data/default/testtb-testConsecutiveExports/d78c68a1a90e6c0d85455c22a0d38646/cf/b9340caf88a140ab88ed6ad7339cd128, entries=6, sequenceid=6, filesize=5.9 K 2023-07-15 21:11:38,943 INFO [rs(jenkins-hbase4.apache.org,39587,1689455451998)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~400 B/400, heapSize ~1.08 KB/1104, currentSize=0 B/0 for d78c68a1a90e6c0d85455c22a0d38646 in 51ms, sequenceid=6, compaction requested=false 2023-07-15 21:11:38,945 DEBUG [rs(jenkins-hbase4.apache.org,39587,1689455451998)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for d78c68a1a90e6c0d85455c22a0d38646: 2023-07-15 21:11:38,945 DEBUG [rs(jenkins-hbase4.apache.org,39587,1689455451998)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,,1689455497697.d78c68a1a90e6c0d85455c22a0d38646.' region-info for snapshot=snaptb0-testConsecutiveExports 2023-07-15 21:11:38,945 DEBUG [rs(jenkins-hbase4.apache.org,39587,1689455451998)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-15 21:11:38,945 DEBUG [rs(jenkins-hbase4.apache.org,39587,1689455451998)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/data/default/testtb-testConsecutiveExports/d78c68a1a90e6c0d85455c22a0d38646/cf/b9340caf88a140ab88ed6ad7339cd128] hfiles 2023-07-15 21:11:38,945 DEBUG [rs(jenkins-hbase4.apache.org,39587,1689455451998)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/data/default/testtb-testConsecutiveExports/d78c68a1a90e6c0d85455c22a0d38646/cf/b9340caf88a140ab88ed6ad7339cd128 for snapshot=snaptb0-testConsecutiveExports 2023-07-15 21:11:38,948 DEBUG [rs(jenkins-hbase4.apache.org,39075,1689455452043)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,1,1689455497697.1fb30bff8fea9087e0ff20afd85442f9. completed. 2023-07-15 21:11:38,948 DEBUG [rs(jenkins-hbase4.apache.org,39075,1689455452043)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,1,1689455497697.1fb30bff8fea9087e0ff20afd85442f9. 2023-07-15 21:11:38,948 DEBUG [member: 'jenkins-hbase4.apache.org,39075,1689455452043' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-15 21:11:38,948 DEBUG [member: 'jenkins-hbase4.apache.org,39075,1689455452043' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-15 21:11:38,948 DEBUG [member: 'jenkins-hbase4.apache.org,39075,1689455452043' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,39075,1689455452043 2023-07-15 21:11:38,949 DEBUG [member: 'jenkins-hbase4.apache.org,39075,1689455452043' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-07-15 21:11:38,949 DEBUG [member: 'jenkins-hbase4.apache.org,39075,1689455452043' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,39075,1689455452043' in zk 2023-07-15 21:11:38,952 DEBUG [rs(jenkins-hbase4.apache.org,39587,1689455451998)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,,1689455497697.d78c68a1a90e6c0d85455c22a0d38646. completed. 2023-07-15 21:11:38,952 DEBUG [rs(jenkins-hbase4.apache.org,39587,1689455451998)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,,1689455497697.d78c68a1a90e6c0d85455c22a0d38646. 2023-07-15 21:11:38,952 DEBUG [member: 'jenkins-hbase4.apache.org,39587,1689455451998' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-15 21:11:38,953 DEBUG [member: 'jenkins-hbase4.apache.org,39587,1689455451998' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-15 21:11:38,953 DEBUG [member: 'jenkins-hbase4.apache.org,39587,1689455451998' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,39587,1689455451998 2023-07-15 21:11:38,953 DEBUG [member: 'jenkins-hbase4.apache.org,39587,1689455451998' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-07-15 21:11:38,953 DEBUG [member: 'jenkins-hbase4.apache.org,39587,1689455451998' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,39587,1689455451998' in zk 2023-07-15 21:11:38,983 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): master:36465-0x1016ad2d8bb0000, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39075,1689455452043 2023-07-15 21:11:38,983 DEBUG [member: 'jenkins-hbase4.apache.org,39075,1689455452043' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-07-15 21:11:38,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39075,1689455452043 2023-07-15 21:11:38,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 21:11:38,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 21:11:38,983 DEBUG [member: 'jenkins-hbase4.apache.org,39075,1689455452043' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 21:11:38,983 DEBUG [member: 'jenkins-hbase4.apache.org,39075,1689455452043' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-07-15 21:11:39,021 DEBUG [member: 'jenkins-hbase4.apache.org,39587,1689455451998' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-07-15 21:11:39,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 21:11:39,021 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): master:36465-0x1016ad2d8bb0000, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39587,1689455451998 2023-07-15 21:11:39,021 DEBUG [member: 'jenkins-hbase4.apache.org,39587,1689455451998' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 21:11:39,022 DEBUG [member: 'jenkins-hbase4.apache.org,39587,1689455451998' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-07-15 21:11:39,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 21:11:39,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-15 21:11:39,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39075,1689455452043 2023-07-15 21:11:39,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39587,1689455451998 2023-07-15 21:11:39,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37853,1689455451932 2023-07-15 21:11:39,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 21:11:39,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-15 21:11:39,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39075,1689455452043 2023-07-15 21:11:39,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39587,1689455451998 2023-07-15 21:11:39,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37853,1689455451932 2023-07-15 21:11:39,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,39075,1689455452043': 2023-07-15 21:11:39,026 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39075,1689455452043' released barrier for procedure'snaptb0-testConsecutiveExports', counting down latch. Waiting for 1 more 2023-07-15 21:11:39,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39587,1689455451998 2023-07-15 21:11:39,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 21:11:39,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 21:11:39,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 21:11:39,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 21:11:39,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-15 21:11:39,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39075,1689455452043 2023-07-15 21:11:39,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39587,1689455451998 2023-07-15 21:11:39,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37853,1689455451932 2023-07-15 21:11:39,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 21:11:39,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-15 21:11:39,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39075,1689455452043 2023-07-15 21:11:39,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39587,1689455451998 2023-07-15 21:11:39,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37853,1689455451932 2023-07-15 21:11:39,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,39587,1689455451998': 2023-07-15 21:11:39,029 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39587,1689455451998' released barrier for procedure'snaptb0-testConsecutiveExports', counting down latch. Waiting for 0 more 2023-07-15 21:11:39,029 INFO [(jenkins-hbase4.apache.org,36465,1689455450507)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testConsecutiveExports' execution completed 2023-07-15 21:11:39,029 DEBUG [(jenkins-hbase4.apache.org,36465,1689455450507)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-15 21:11:39,029 DEBUG [(jenkins-hbase4.apache.org,36465,1689455450507)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-15 21:11:39,029 DEBUG [(jenkins-hbase4.apache.org,36465,1689455450507)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testConsecutiveExports 2023-07-15 21:11:39,029 INFO [(jenkins-hbase4.apache.org,36465,1689455450507)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testConsecutiveExportsincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-15 21:11:39,048 DEBUG [Listener at jenkins-hbase4.apache.org/41711] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-15 21:11:39,049 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36465] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-15 21:11:39,049 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36465] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' is still in progress! 2023-07-15 21:11:39,049 DEBUG [Listener at jenkins-hbase4.apache.org/41711] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-15 21:11:39,060 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): regionserver:39075-0x1016ad2d8bb0003, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-15 21:11:39,060 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): regionserver:37853-0x1016ad2d8bb0001, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-15 21:11:39,060 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): master:36465-0x1016ad2d8bb0000, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-15 21:11:39,060 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-15 21:11:39,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-15 21:11:39,060 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): regionserver:39587-0x1016ad2d8bb0002, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-15 21:11:39,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-15 21:11:39,060 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-15 21:11:39,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-15 21:11:39,060 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): regionserver:37853-0x1016ad2d8bb0001, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 21:11:39,060 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-15 21:11:39,061 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-15 21:11:39,061 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 21:11:39,060 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): regionserver:39075-0x1016ad2d8bb0003, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 21:11:39,061 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 21:11:39,061 DEBUG [(jenkins-hbase4.apache.org,36465,1689455450507)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36465-0x1016ad2d8bb0000, quorum=127.0.0.1:50024, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39075,1689455452043 2023-07-15 21:11:39,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 21:11:39,061 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 21:11:39,061 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 21:11:39,060 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): regionserver:39587-0x1016ad2d8bb0002, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 21:11:39,061 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 21:11:39,061 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 21:11:39,061 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 21:11:39,061 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-15 21:11:39,061 DEBUG [(jenkins-hbase4.apache.org,36465,1689455450507)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36465-0x1016ad2d8bb0000, quorum=127.0.0.1:50024, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39587,1689455451998 2023-07-15 21:11:39,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-15 21:11:39,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 21:11:39,062 DEBUG [(jenkins-hbase4.apache.org,36465,1689455450507)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36465-0x1016ad2d8bb0000, quorum=127.0.0.1:50024, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37853,1689455451932 2023-07-15 21:11:39,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-15 21:11:39,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-15 21:11:39,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 21:11:39,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-15 21:11:39,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39075,1689455452043 2023-07-15 21:11:39,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39587,1689455451998 2023-07-15 21:11:39,064 DEBUG [(jenkins-hbase4.apache.org,36465,1689455450507)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36465-0x1016ad2d8bb0000, quorum=127.0.0.1:50024, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39075,1689455452043 2023-07-15 21:11:39,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37853,1689455451932 2023-07-15 21:11:39,065 DEBUG [(jenkins-hbase4.apache.org,36465,1689455450507)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36465-0x1016ad2d8bb0000, quorum=127.0.0.1:50024, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39587,1689455451998 2023-07-15 21:11:39,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 21:11:39,065 DEBUG [(jenkins-hbase4.apache.org,36465,1689455450507)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36465-0x1016ad2d8bb0000, quorum=127.0.0.1:50024, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37853,1689455451932 2023-07-15 21:11:39,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-15 21:11:39,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39075,1689455452043 2023-07-15 21:11:39,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39587,1689455451998 2023-07-15 21:11:39,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37853,1689455451932 2023-07-15 21:11:39,260 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): regionserver:37853-0x1016ad2d8bb0001, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 21:11:39,260 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): regionserver:39075-0x1016ad2d8bb0003, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 21:11:39,260 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): regionserver:37853-0x1016ad2d8bb0001, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 21:11:39,260 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): regionserver:39075-0x1016ad2d8bb0003, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 21:11:39,261 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): regionserver:39587-0x1016ad2d8bb0002, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 21:11:39,261 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 21:11:39,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 21:11:39,261 DEBUG [(jenkins-hbase4.apache.org,36465,1689455450507)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 21:11:39,260 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): master:36465-0x1016ad2d8bb0000, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37853,1689455451932 2023-07-15 21:11:39,263 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): master:36465-0x1016ad2d8bb0000, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-15 21:11:39,263 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): master:36465-0x1016ad2d8bb0000, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39587,1689455451998 2023-07-15 21:11:39,263 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 21:11:39,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 21:11:39,261 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testConsecutiveExports 2023-07-15 21:11:39,263 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testConsecutiveExports 2023-07-15 21:11:39,261 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 21:11:39,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 21:11:39,261 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): regionserver:39587-0x1016ad2d8bb0002, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 21:11:39,263 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): master:36465-0x1016ad2d8bb0000, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39075,1689455452043 2023-07-15 21:11:39,264 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): master:36465-0x1016ad2d8bb0000, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-15 21:11:39,264 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): master:36465-0x1016ad2d8bb0000, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37853,1689455451932 2023-07-15 21:11:39,264 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): master:36465-0x1016ad2d8bb0000, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-15 21:11:39,264 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => c7b48a2e62736c517f8bfa7d64fc37ac, NAME => 'testtb-testConsecutiveExports,.mob,0.c7b48a2e62736c517f8bfa7d64fc37ac.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testConsecutiveExports 2023-07-15 21:11:39,264 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): master:36465-0x1016ad2d8bb0000, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39587,1689455451998 2023-07-15 21:11:39,264 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): master:36465-0x1016ad2d8bb0000, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39075,1689455452043 2023-07-15 21:11:39,264 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): master:36465-0x1016ad2d8bb0000, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-15 21:11:39,264 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): master:36465-0x1016ad2d8bb0000, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-15 21:11:39,264 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 21:11:39,264 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-15 21:11:39,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 21:11:39,265 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 21:11:39,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 21:11:39,265 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 21:11:39,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 21:11:39,268 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b202307151c4021e2d0db4f16aeb85798885912f5, hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e20230715b825f6f68ac64a9da9970d0a4335d4ae] mob files 2023-07-15 21:11:39,268 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b202307151c4021e2d0db4f16aeb85798885912f5 2023-07-15 21:11:39,269 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e20230715b825f6f68ac64a9da9970d0a4335d4ae 2023-07-15 21:11:39,284 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testConsecutiveExports 2023-07-15 21:11:39,285 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-15 21:11:39,309 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports to hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-15 21:11:39,335 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed 2023-07-15 21:11:39,335 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-15 21:11:39,335 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-15 21:11:39,335 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports at 1689455498745Completed referencing HFiles for the mob region of table: testtb-testConsecutiveExports at 1689455499284 (+539 ms)Consolidate snapshot: snaptb0-testConsecutiveExports at 1689455499284Loading Region manifests for snaptb0-testConsecutiveExports at 1689455499284Writing data manifest for snaptb0-testConsecutiveExports at 1689455499288 (+4 ms)Verifying snapshot: snaptb0-testConsecutiveExports at 1689455499297 (+9 ms)Snapshot snaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed at 1689455499335 (+38 ms) 2023-07-15 21:11:39,339 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=50, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-15 21:11:39,340 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=50, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED in 593 msec 2023-07-15 21:11:39,349 DEBUG [Listener at jenkins-hbase4.apache.org/41711] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-15 21:11:39,350 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36465] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-15 21:11:39,350 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36465] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-15 21:11:39,351 INFO [Listener at jenkins-hbase4.apache.org/41711] snapshot.TestExportSnapshot(389): Local export destination path: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/de3e87f0-08fc-c0d0-c969-4c410fd4e6fd/local-export-1689455499351 2023-07-15 21:11:39,351 INFO [Listener at jenkins-hbase4.apache.org/41711] snapshot.TestExportSnapshot(255): tgtFsUri=file:///, tgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/de3e87f0-08fc-c0d0-c969-4c410fd4e6fd/local-export-1689455499351, rawTgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/de3e87f0-08fc-c0d0-c969-4c410fd4e6fd/local-export-1689455499351, srcFsUri=hdfs://localhost:46859, srcDir=hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313 2023-07-15 21:11:39,377 DEBUG [Listener at jenkins-hbase4.apache.org/41711] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:46859, inputRoot=hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313 2023-07-15 21:11:39,378 DEBUG [Listener at jenkins-hbase4.apache.org/41711] snapshot.ExportSnapshot(999): outputFs=org.apache.hadoop.fs.LocalFileSystem@6ee4197a, outputRoot=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/de3e87f0-08fc-c0d0-c969-4c410fd4e6fd/local-export-1689455499351, skipTmp=false, initialOutputSnapshotDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/de3e87f0-08fc-c0d0-c969-4c410fd4e6fd/local-export-1689455499351/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-15 21:11:39,378 INFO [Listener at jenkins-hbase4.apache.org/41711] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:46859, inputRoot=hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313, snapshotDir=hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/.hbase-snapshot/snaptb0-testConsecutiveExports. 2023-07-15 21:11:39,402 INFO [Listener at jenkins-hbase4.apache.org/41711] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/.hbase-snapshot/snaptb0-testConsecutiveExports to file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/de3e87f0-08fc-c0d0-c969-4c410fd4e6fd/local-export-1689455499351/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-15 21:11:39,417 DEBUG [Listener at jenkins-hbase4.apache.org/41711] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-15 21:11:39,418 DEBUG [Listener at jenkins-hbase4.apache.org/41711] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-15 21:11:39,418 DEBUG [Listener at jenkins-hbase4.apache.org/41711] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-15 21:11:39,418 DEBUG [Listener at jenkins-hbase4.apache.org/41711] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-15 21:11:39,419 DEBUG [Listener at jenkins-hbase4.apache.org/41711] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-15 21:11:39,419 DEBUG [Listener at jenkins-hbase4.apache.org/41711] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-15 21:11:39,419 DEBUG [Listener at jenkins-hbase4.apache.org/41711] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-15 21:11:39,489 DEBUG [Listener at jenkins-hbase4.apache.org/41711] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/de3e87f0-08fc-c0d0-c969-4c410fd4e6fd/hadoop-115547783023778833.jar 2023-07-15 21:11:39,490 DEBUG [Listener at jenkins-hbase4.apache.org/41711] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-15 21:11:39,490 DEBUG [Listener at jenkins-hbase4.apache.org/41711] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-15 21:11:39,491 DEBUG [Listener at jenkins-hbase4.apache.org/41711] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-15 21:11:39,491 DEBUG [Listener at jenkins-hbase4.apache.org/41711] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-15 21:11:39,492 DEBUG [Listener at jenkins-hbase4.apache.org/41711] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-15 21:11:39,492 DEBUG [Listener at jenkins-hbase4.apache.org/41711] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-15 21:11:39,492 DEBUG [Listener at jenkins-hbase4.apache.org/41711] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-15 21:11:39,493 DEBUG [Listener at jenkins-hbase4.apache.org/41711] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-15 21:11:39,493 DEBUG [Listener at jenkins-hbase4.apache.org/41711] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-15 21:11:39,493 DEBUG [Listener at jenkins-hbase4.apache.org/41711] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-15 21:11:39,494 DEBUG [Listener at jenkins-hbase4.apache.org/41711] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-15 21:11:39,494 DEBUG [Listener at jenkins-hbase4.apache.org/41711] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-15 21:11:39,495 DEBUG [Listener at jenkins-hbase4.apache.org/41711] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-15 21:11:39,495 DEBUG [Listener at jenkins-hbase4.apache.org/41711] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-15 21:11:39,495 DEBUG [Listener at jenkins-hbase4.apache.org/41711] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-15 21:11:39,496 DEBUG [Listener at jenkins-hbase4.apache.org/41711] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-15 21:11:39,496 DEBUG [Listener at jenkins-hbase4.apache.org/41711] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-15 21:11:39,496 DEBUG [Listener at jenkins-hbase4.apache.org/41711] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-15 21:11:39,497 DEBUG [Listener at jenkins-hbase4.apache.org/41711] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-15 21:11:39,497 DEBUG [Listener at jenkins-hbase4.apache.org/41711] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-15 21:11:39,497 DEBUG [Listener at jenkins-hbase4.apache.org/41711] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-15 21:11:39,498 DEBUG [Listener at jenkins-hbase4.apache.org/41711] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-15 21:11:39,498 DEBUG [Listener at jenkins-hbase4.apache.org/41711] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-15 21:11:39,853 WARN [Listener at jenkins-hbase4.apache.org/41711] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-15 21:11:39,855 INFO [Listener at jenkins-hbase4.apache.org/41711] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testConsecutiveExports' hfile list 2023-07-15 21:11:39,857 DEBUG [Listener at jenkins-hbase4.apache.org/41711] snapshot.ExportSnapshot(671): export split=0 size=30.8 K 2023-07-15 21:11:41,939 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-15 21:11:41,939 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-15 21:11:41,943 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689455459463_0002_000001 (auth:SIMPLE) 2023-07-15 21:11:42,822 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689455459463_0003_000001 (auth:SIMPLE) 2023-07-15 21:11:42,967 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-15 21:11:47,412 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689455459463_0003_000001 (auth:SIMPLE) 2023-07-15 21:11:49,671 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689455459463_0003_000001 (auth:SIMPLE) 2023-07-15 21:11:52,509 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689455459463_0003_000001 (auth:SIMPLE) 2023-07-15 21:11:54,047 INFO [Listener at jenkins-hbase4.apache.org/41711] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-15 21:11:54,047 INFO [Listener at jenkins-hbase4.apache.org/41711] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-15 21:11:54,052 INFO [Listener at jenkins-hbase4.apache.org/41711] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testConsecutiveExports 2023-07-15 21:11:54,052 INFO [Listener at jenkins-hbase4.apache.org/41711] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-15 21:11:54,053 INFO [Listener at jenkins-hbase4.apache.org/41711] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-15 21:11:54,053 DEBUG [Listener at jenkins-hbase4.apache.org/41711] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1600112846_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/.hbase-snapshot/snaptb0-testConsecutiveExports at hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-15 21:11:54,056 DEBUG [Listener at jenkins-hbase4.apache.org/41711] snapshot.TestExportSnapshot(367): hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-07-15 21:11:54,056 DEBUG [Listener at jenkins-hbase4.apache.org/41711] snapshot.TestExportSnapshot(367): hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-07-15 21:11:54,056 DEBUG [Listener at jenkins-hbase4.apache.org/41711] snapshot.TestExportSnapshot(362): List files in org.apache.hadoop.fs.LocalFileSystem@4d12d4a in root file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/de3e87f0-08fc-c0d0-c969-4c410fd4e6fd/local-export-1689455499351/.hbase-snapshot/snaptb0-testConsecutiveExports at file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/de3e87f0-08fc-c0d0-c969-4c410fd4e6fd/local-export-1689455499351/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-15 21:11:54,056 DEBUG [Listener at jenkins-hbase4.apache.org/41711] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/de3e87f0-08fc-c0d0-c969-4c410fd4e6fd/local-export-1689455499351/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-07-15 21:11:54,056 DEBUG [Listener at jenkins-hbase4.apache.org/41711] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/de3e87f0-08fc-c0d0-c969-4c410fd4e6fd/local-export-1689455499351/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-07-15 21:11:54,058 INFO [Listener at jenkins-hbase4.apache.org/41711] snapshot.TestExportSnapshot(255): tgtFsUri=file:///, tgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/de3e87f0-08fc-c0d0-c969-4c410fd4e6fd/local-export-1689455499351, rawTgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/de3e87f0-08fc-c0d0-c969-4c410fd4e6fd/local-export-1689455499351, srcFsUri=hdfs://localhost:46859, srcDir=hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313 2023-07-15 21:11:54,084 DEBUG [Listener at jenkins-hbase4.apache.org/41711] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:46859, inputRoot=hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313 2023-07-15 21:11:54,084 DEBUG [Listener at jenkins-hbase4.apache.org/41711] snapshot.ExportSnapshot(999): outputFs=org.apache.hadoop.fs.LocalFileSystem@21c88cae, outputRoot=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/de3e87f0-08fc-c0d0-c969-4c410fd4e6fd/local-export-1689455499351, skipTmp=false, initialOutputSnapshotDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/de3e87f0-08fc-c0d0-c969-4c410fd4e6fd/local-export-1689455499351/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-15 21:11:54,084 INFO [Listener at jenkins-hbase4.apache.org/41711] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:46859, inputRoot=hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313, snapshotDir=hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/.hbase-snapshot/snaptb0-testConsecutiveExports. 2023-07-15 21:11:54,101 INFO [Listener at jenkins-hbase4.apache.org/41711] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/.hbase-snapshot/snaptb0-testConsecutiveExports to file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/de3e87f0-08fc-c0d0-c969-4c410fd4e6fd/local-export-1689455499351/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-15 21:11:54,114 DEBUG [Listener at jenkins-hbase4.apache.org/41711] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-15 21:11:54,114 DEBUG [Listener at jenkins-hbase4.apache.org/41711] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-15 21:11:54,115 DEBUG [Listener at jenkins-hbase4.apache.org/41711] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-15 21:11:54,115 DEBUG [Listener at jenkins-hbase4.apache.org/41711] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-15 21:11:54,115 DEBUG [Listener at jenkins-hbase4.apache.org/41711] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-15 21:11:54,116 DEBUG [Listener at jenkins-hbase4.apache.org/41711] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-15 21:11:54,116 DEBUG [Listener at jenkins-hbase4.apache.org/41711] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-15 21:11:54,196 DEBUG [Listener at jenkins-hbase4.apache.org/41711] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/de3e87f0-08fc-c0d0-c969-4c410fd4e6fd/hadoop-1933488711432085057.jar 2023-07-15 21:11:54,197 DEBUG [Listener at jenkins-hbase4.apache.org/41711] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-15 21:11:54,197 DEBUG [Listener at jenkins-hbase4.apache.org/41711] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-15 21:11:54,197 DEBUG [Listener at jenkins-hbase4.apache.org/41711] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-15 21:11:54,197 DEBUG [Listener at jenkins-hbase4.apache.org/41711] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-15 21:11:54,198 DEBUG [Listener at jenkins-hbase4.apache.org/41711] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-15 21:11:54,198 DEBUG [Listener at jenkins-hbase4.apache.org/41711] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-15 21:11:54,199 DEBUG [Listener at jenkins-hbase4.apache.org/41711] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-15 21:11:54,199 DEBUG [Listener at jenkins-hbase4.apache.org/41711] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-15 21:11:54,199 DEBUG [Listener at jenkins-hbase4.apache.org/41711] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-15 21:11:54,200 DEBUG [Listener at jenkins-hbase4.apache.org/41711] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-15 21:11:54,200 DEBUG [Listener at jenkins-hbase4.apache.org/41711] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-15 21:11:54,201 DEBUG [Listener at jenkins-hbase4.apache.org/41711] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-15 21:11:54,201 DEBUG [Listener at jenkins-hbase4.apache.org/41711] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-15 21:11:54,201 DEBUG [Listener at jenkins-hbase4.apache.org/41711] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-15 21:11:54,201 DEBUG [Listener at jenkins-hbase4.apache.org/41711] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-15 21:11:54,202 DEBUG [Listener at jenkins-hbase4.apache.org/41711] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-15 21:11:54,202 DEBUG [Listener at jenkins-hbase4.apache.org/41711] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-15 21:11:54,203 DEBUG [Listener at jenkins-hbase4.apache.org/41711] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-15 21:11:54,203 DEBUG [Listener at jenkins-hbase4.apache.org/41711] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-15 21:11:54,203 DEBUG [Listener at jenkins-hbase4.apache.org/41711] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-15 21:11:54,203 DEBUG [Listener at jenkins-hbase4.apache.org/41711] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-15 21:11:54,204 DEBUG [Listener at jenkins-hbase4.apache.org/41711] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-15 21:11:54,204 DEBUG [Listener at jenkins-hbase4.apache.org/41711] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-15 21:11:54,588 WARN [Listener at jenkins-hbase4.apache.org/41711] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-15 21:11:54,591 INFO [Listener at jenkins-hbase4.apache.org/41711] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testConsecutiveExports' hfile list 2023-07-15 21:11:54,593 DEBUG [Listener at jenkins-hbase4.apache.org/41711] snapshot.ExportSnapshot(671): export split=0 size=30.8 K 2023-07-15 21:11:58,701 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-15 21:11:58,702 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-15 21:11:58,704 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689455459463_0003_000001 (auth:SIMPLE) 2023-07-15 21:11:58,953 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689455459463_0004_000001 (auth:SIMPLE) 2023-07-15 21:12:03,629 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689455459463_0004_000001 (auth:SIMPLE) 2023-07-15 21:12:05,915 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689455459463_0004_000001 (auth:SIMPLE) 2023-07-15 21:12:09,091 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689455459463_0004_000001 (auth:SIMPLE) 2023-07-15 21:12:10,921 INFO [Listener at jenkins-hbase4.apache.org/41711] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-15 21:12:10,922 INFO [Listener at jenkins-hbase4.apache.org/41711] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-15 21:12:10,927 INFO [Listener at jenkins-hbase4.apache.org/41711] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testConsecutiveExports 2023-07-15 21:12:10,927 INFO [Listener at jenkins-hbase4.apache.org/41711] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-15 21:12:10,927 INFO [Listener at jenkins-hbase4.apache.org/41711] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-15 21:12:10,927 DEBUG [Listener at jenkins-hbase4.apache.org/41711] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1600112846_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/.hbase-snapshot/snaptb0-testConsecutiveExports at hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-15 21:12:10,932 DEBUG [Listener at jenkins-hbase4.apache.org/41711] snapshot.TestExportSnapshot(367): hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-07-15 21:12:10,932 DEBUG [Listener at jenkins-hbase4.apache.org/41711] snapshot.TestExportSnapshot(367): hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-07-15 21:12:10,932 DEBUG [Listener at jenkins-hbase4.apache.org/41711] snapshot.TestExportSnapshot(362): List files in org.apache.hadoop.fs.LocalFileSystem@4d12d4a in root file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/de3e87f0-08fc-c0d0-c969-4c410fd4e6fd/local-export-1689455499351/.hbase-snapshot/snaptb0-testConsecutiveExports at file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/de3e87f0-08fc-c0d0-c969-4c410fd4e6fd/local-export-1689455499351/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-15 21:12:10,932 DEBUG [Listener at jenkins-hbase4.apache.org/41711] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/de3e87f0-08fc-c0d0-c969-4c410fd4e6fd/local-export-1689455499351/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-07-15 21:12:10,932 DEBUG [Listener at jenkins-hbase4.apache.org/41711] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/de3e87f0-08fc-c0d0-c969-4c410fd4e6fd/local-export-1689455499351/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-07-15 21:12:10,946 INFO [Listener at jenkins-hbase4.apache.org/41711] client.HBaseAdmin$15(890): Started disable of testtb-testConsecutiveExports 2023-07-15 21:12:10,946 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36465] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testConsecutiveExports 2023-07-15 21:12:10,955 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36465] procedure2.ProcedureExecutor(1029): Stored pid=51, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testConsecutiveExports 2023-07-15 21:12:10,959 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36465] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-07-15 21:12:10,960 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689455530960"}]},"ts":"1689455530960"} 2023-07-15 21:12:10,962 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=DISABLING in hbase:meta 2023-07-15 21:12:10,964 INFO [PEWorker-1] procedure.DisableTableProcedure(293): Set testtb-testConsecutiveExports to state=DISABLING 2023-07-15 21:12:10,964 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=52, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=d78c68a1a90e6c0d85455c22a0d38646, UNASSIGN}, {pid=53, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=1fb30bff8fea9087e0ff20afd85442f9, UNASSIGN}] 2023-07-15 21:12:10,965 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=52, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=d78c68a1a90e6c0d85455c22a0d38646, UNASSIGN 2023-07-15 21:12:10,967 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=53, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=1fb30bff8fea9087e0ff20afd85442f9, UNASSIGN 2023-07-15 21:12:10,968 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=52 updating hbase:meta row=d78c68a1a90e6c0d85455c22a0d38646, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,39587,1689455451998 2023-07-15 21:12:10,968 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,,1689455497697.d78c68a1a90e6c0d85455c22a0d38646.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689455530967"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689455530967"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689455530967"}]},"ts":"1689455530967"} 2023-07-15 21:12:10,970 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=53 updating hbase:meta row=1fb30bff8fea9087e0ff20afd85442f9, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,39075,1689455452043 2023-07-15 21:12:10,970 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,1,1689455497697.1fb30bff8fea9087e0ff20afd85442f9.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689455530970"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689455530970"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689455530970"}]},"ts":"1689455530970"} 2023-07-15 21:12:10,970 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=54, ppid=52, state=RUNNABLE; CloseRegionProcedure d78c68a1a90e6c0d85455c22a0d38646, server=jenkins-hbase4.apache.org,39587,1689455451998}] 2023-07-15 21:12:10,972 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=55, ppid=53, state=RUNNABLE; CloseRegionProcedure 1fb30bff8fea9087e0ff20afd85442f9, server=jenkins-hbase4.apache.org,39075,1689455452043}] 2023-07-15 21:12:11,060 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36465] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-07-15 21:12:11,122 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close d78c68a1a90e6c0d85455c22a0d38646 2023-07-15 21:12:11,123 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing d78c68a1a90e6c0d85455c22a0d38646, disabling compactions & flushes 2023-07-15 21:12:11,123 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,,1689455497697.d78c68a1a90e6c0d85455c22a0d38646. 2023-07-15 21:12:11,123 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,,1689455497697.d78c68a1a90e6c0d85455c22a0d38646. 2023-07-15 21:12:11,123 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,,1689455497697.d78c68a1a90e6c0d85455c22a0d38646. after waiting 0 ms 2023-07-15 21:12:11,123 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,,1689455497697.d78c68a1a90e6c0d85455c22a0d38646. 2023-07-15 21:12:11,127 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 1fb30bff8fea9087e0ff20afd85442f9 2023-07-15 21:12:11,127 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 1fb30bff8fea9087e0ff20afd85442f9, disabling compactions & flushes 2023-07-15 21:12:11,127 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,1,1689455497697.1fb30bff8fea9087e0ff20afd85442f9. 2023-07-15 21:12:11,127 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,1,1689455497697.1fb30bff8fea9087e0ff20afd85442f9. 2023-07-15 21:12:11,127 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,1,1689455497697.1fb30bff8fea9087e0ff20afd85442f9. after waiting 0 ms 2023-07-15 21:12:11,127 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,1,1689455497697.1fb30bff8fea9087e0ff20afd85442f9. 2023-07-15 21:12:11,139 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/data/default/testtb-testConsecutiveExports/d78c68a1a90e6c0d85455c22a0d38646/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-15 21:12:11,139 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-15 21:12:11,140 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,,1689455497697.d78c68a1a90e6c0d85455c22a0d38646. 2023-07-15 21:12:11,140 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for d78c68a1a90e6c0d85455c22a0d38646: 2023-07-15 21:12:11,140 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/data/default/testtb-testConsecutiveExports/1fb30bff8fea9087e0ff20afd85442f9/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-15 21:12:11,141 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-15 21:12:11,142 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,1,1689455497697.1fb30bff8fea9087e0ff20afd85442f9. 2023-07-15 21:12:11,142 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 1fb30bff8fea9087e0ff20afd85442f9: 2023-07-15 21:12:11,143 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed d78c68a1a90e6c0d85455c22a0d38646 2023-07-15 21:12:11,144 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=52 updating hbase:meta row=d78c68a1a90e6c0d85455c22a0d38646, regionState=CLOSED 2023-07-15 21:12:11,144 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,,1689455497697.d78c68a1a90e6c0d85455c22a0d38646.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689455531144"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689455531144"}]},"ts":"1689455531144"} 2023-07-15 21:12:11,144 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 1fb30bff8fea9087e0ff20afd85442f9 2023-07-15 21:12:11,145 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=53 updating hbase:meta row=1fb30bff8fea9087e0ff20afd85442f9, regionState=CLOSED 2023-07-15 21:12:11,145 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,1,1689455497697.1fb30bff8fea9087e0ff20afd85442f9.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689455531145"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689455531145"}]},"ts":"1689455531145"} 2023-07-15 21:12:11,150 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=54, resume processing ppid=52 2023-07-15 21:12:11,150 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=54, ppid=52, state=SUCCESS; CloseRegionProcedure d78c68a1a90e6c0d85455c22a0d38646, server=jenkins-hbase4.apache.org,39587,1689455451998 in 176 msec 2023-07-15 21:12:11,150 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=55, resume processing ppid=53 2023-07-15 21:12:11,151 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=55, ppid=53, state=SUCCESS; CloseRegionProcedure 1fb30bff8fea9087e0ff20afd85442f9, server=jenkins-hbase4.apache.org,39075,1689455452043 in 175 msec 2023-07-15 21:12:11,152 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=52, ppid=51, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=d78c68a1a90e6c0d85455c22a0d38646, UNASSIGN in 186 msec 2023-07-15 21:12:11,153 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=53, resume processing ppid=51 2023-07-15 21:12:11,153 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=53, ppid=51, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=1fb30bff8fea9087e0ff20afd85442f9, UNASSIGN in 187 msec 2023-07-15 21:12:11,154 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689455531154"}]},"ts":"1689455531154"} 2023-07-15 21:12:11,155 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=DISABLED in hbase:meta 2023-07-15 21:12:11,157 INFO [PEWorker-4] procedure.DisableTableProcedure(305): Set testtb-testConsecutiveExports to state=DISABLED 2023-07-15 21:12:11,160 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=51, state=SUCCESS; DisableTableProcedure table=testtb-testConsecutiveExports in 213 msec 2023-07-15 21:12:11,262 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36465] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-07-15 21:12:11,262 INFO [Listener at jenkins-hbase4.apache.org/41711] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testConsecutiveExports, procId: 51 completed 2023-07-15 21:12:11,263 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36465] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testConsecutiveExports 2023-07-15 21:12:11,264 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36465] procedure2.ProcedureExecutor(1029): Stored pid=56, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-15 21:12:11,266 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=56, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-15 21:12:11,267 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36465] access.PermissionStorage(259): Removing permissions of removed table testtb-testConsecutiveExports 2023-07-15 21:12:11,267 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=56, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-15 21:12:11,272 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=39075] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testConsecutiveExports 2023-07-15 21:12:11,275 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/.tmp/data/default/testtb-testConsecutiveExports/d78c68a1a90e6c0d85455c22a0d38646 2023-07-15 21:12:11,275 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/.tmp/data/default/testtb-testConsecutiveExports/1fb30bff8fea9087e0ff20afd85442f9 2023-07-15 21:12:11,278 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/.tmp/data/default/testtb-testConsecutiveExports/d78c68a1a90e6c0d85455c22a0d38646/cf, FileablePath, hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/.tmp/data/default/testtb-testConsecutiveExports/d78c68a1a90e6c0d85455c22a0d38646/recovered.edits] 2023-07-15 21:12:11,278 DEBUG [HFileArchiver-14] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/.tmp/data/default/testtb-testConsecutiveExports/1fb30bff8fea9087e0ff20afd85442f9/cf, FileablePath, hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/.tmp/data/default/testtb-testConsecutiveExports/1fb30bff8fea9087e0ff20afd85442f9/recovered.edits] 2023-07-15 21:12:11,282 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): regionserver:39075-0x1016ad2d8bb0003, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-15 21:12:11,282 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): regionserver:39587-0x1016ad2d8bb0002, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-15 21:12:11,282 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): master:36465-0x1016ad2d8bb0000, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-15 21:12:11,282 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): regionserver:37853-0x1016ad2d8bb0001, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-15 21:12:11,283 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-07-15 21:12:11,283 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-07-15 21:12:11,283 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-07-15 21:12:11,283 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-07-15 21:12:11,285 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): master:36465-0x1016ad2d8bb0000, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-15 21:12:11,285 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): master:36465-0x1016ad2d8bb0000, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 21:12:11,285 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): regionserver:39587-0x1016ad2d8bb0002, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-15 21:12:11,285 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): regionserver:39587-0x1016ad2d8bb0002, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 21:12:11,285 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): regionserver:37853-0x1016ad2d8bb0001, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-15 21:12:11,285 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): regionserver:37853-0x1016ad2d8bb0001, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 21:12:11,286 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): regionserver:39075-0x1016ad2d8bb0003, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-15 21:12:11,286 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): regionserver:39075-0x1016ad2d8bb0003, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 21:12:11,287 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36465] master.MasterRpcServices(1230): Checking to see if procedure is done pid=56 2023-07-15 21:12:11,287 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/.tmp/data/default/testtb-testConsecutiveExports/d78c68a1a90e6c0d85455c22a0d38646/cf/b9340caf88a140ab88ed6ad7339cd128 to hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/archive/data/default/testtb-testConsecutiveExports/d78c68a1a90e6c0d85455c22a0d38646/cf/b9340caf88a140ab88ed6ad7339cd128 2023-07-15 21:12:11,287 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/.tmp/data/default/testtb-testConsecutiveExports/1fb30bff8fea9087e0ff20afd85442f9/cf/06c88f302fce487b98ba154fe3ac95d3 to hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/archive/data/default/testtb-testConsecutiveExports/1fb30bff8fea9087e0ff20afd85442f9/cf/06c88f302fce487b98ba154fe3ac95d3 2023-07-15 21:12:11,290 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/.tmp/data/default/testtb-testConsecutiveExports/d78c68a1a90e6c0d85455c22a0d38646/recovered.edits/9.seqid to hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/archive/data/default/testtb-testConsecutiveExports/d78c68a1a90e6c0d85455c22a0d38646/recovered.edits/9.seqid 2023-07-15 21:12:11,291 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/.tmp/data/default/testtb-testConsecutiveExports/1fb30bff8fea9087e0ff20afd85442f9/recovered.edits/9.seqid to hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/archive/data/default/testtb-testConsecutiveExports/1fb30bff8fea9087e0ff20afd85442f9/recovered.edits/9.seqid 2023-07-15 21:12:11,291 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/.tmp/data/default/testtb-testConsecutiveExports/d78c68a1a90e6c0d85455c22a0d38646 2023-07-15 21:12:11,291 DEBUG [HFileArchiver-14] backup.HFileArchiver(596): Deleted hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/.tmp/data/default/testtb-testConsecutiveExports/1fb30bff8fea9087e0ff20afd85442f9 2023-07-15 21:12:11,291 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testConsecutiveExports regions 2023-07-15 21:12:11,292 DEBUG [PEWorker-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac 2023-07-15 21:12:11,293 DEBUG [PEWorker-2] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf] 2023-07-15 21:12:11,296 DEBUG [PEWorker-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b202307151c4021e2d0db4f16aeb85798885912f5 to hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/archive/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b202307151c4021e2d0db4f16aeb85798885912f5 2023-07-15 21:12:11,297 DEBUG [PEWorker-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e20230715b825f6f68ac64a9da9970d0a4335d4ae to hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/archive/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e20230715b825f6f68ac64a9da9970d0a4335d4ae 2023-07-15 21:12:11,298 DEBUG [PEWorker-2] backup.HFileArchiver(596): Deleted hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac 2023-07-15 21:12:11,300 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=56, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-15 21:12:11,303 WARN [PEWorker-2] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testConsecutiveExports from hbase:meta 2023-07-15 21:12:11,305 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(421): Removing 'testtb-testConsecutiveExports' descriptor. 2023-07-15 21:12:11,306 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=56, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-15 21:12:11,306 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(411): Removing 'testtb-testConsecutiveExports' from region states. 2023-07-15 21:12:11,306 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports,,1689455497697.d78c68a1a90e6c0d85455c22a0d38646.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689455531306"}]},"ts":"9223372036854775807"} 2023-07-15 21:12:11,306 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports,1,1689455497697.1fb30bff8fea9087e0ff20afd85442f9.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689455531306"}]},"ts":"9223372036854775807"} 2023-07-15 21:12:11,308 INFO [PEWorker-2] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-15 21:12:11,308 DEBUG [PEWorker-2] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => d78c68a1a90e6c0d85455c22a0d38646, NAME => 'testtb-testConsecutiveExports,,1689455497697.d78c68a1a90e6c0d85455c22a0d38646.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 1fb30bff8fea9087e0ff20afd85442f9, NAME => 'testtb-testConsecutiveExports,1,1689455497697.1fb30bff8fea9087e0ff20afd85442f9.', STARTKEY => '1', ENDKEY => ''}] 2023-07-15 21:12:11,308 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(415): Marking 'testtb-testConsecutiveExports' as deleted. 2023-07-15 21:12:11,309 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689455531308"}]},"ts":"9223372036854775807"} 2023-07-15 21:12:11,310 INFO [PEWorker-2] hbase.MetaTableAccessor(1658): Deleted table testtb-testConsecutiveExports state from META 2023-07-15 21:12:11,312 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(130): Finished pid=56, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-15 21:12:11,314 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=56, state=SUCCESS; DeleteTableProcedure table=testtb-testConsecutiveExports in 49 msec 2023-07-15 21:12:11,388 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36465] master.MasterRpcServices(1230): Checking to see if procedure is done pid=56 2023-07-15 21:12:11,388 INFO [Listener at jenkins-hbase4.apache.org/41711] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testConsecutiveExports, procId: 56 completed 2023-07-15 21:12:11,396 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36465] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testConsecutiveExports" 2023-07-15 21:12:11,398 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36465] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testConsecutiveExports 2023-07-15 21:12:11,399 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36465] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testConsecutiveExports" 2023-07-15 21:12:11,401 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36465] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testConsecutiveExports 2023-07-15 21:12:11,430 INFO [Listener at jenkins-hbase4.apache.org/41711] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testConsecutiveExports Thread=746 (was 765), OpenFileDescriptor=906 (was 925), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=341 (was 317) - SystemLoadAverage LEAK? -, ProcessCount=178 (was 180), AvailableMemoryMB=3637 (was 2922) - AvailableMemoryMB LEAK? - 2023-07-15 21:12:11,430 WARN [Listener at jenkins-hbase4.apache.org/41711] hbase.ResourceChecker(130): Thread=746 is superior to 500 2023-07-15 21:12:11,453 INFO [Listener at jenkins-hbase4.apache.org/41711] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithMergeRegion Thread=746, OpenFileDescriptor=906, MaxFileDescriptor=60000, SystemLoadAverage=341, ProcessCount=178, AvailableMemoryMB=3637 2023-07-15 21:12:11,453 WARN [Listener at jenkins-hbase4.apache.org/41711] hbase.ResourceChecker(130): Thread=746 is superior to 500 2023-07-15 21:12:11,455 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36465] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-07-15 21:12:11,456 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36465] procedure2.ProcedureExecutor(1029): Stored pid=57, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-15 21:12:11,458 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_PRE_OPERATION 2023-07-15 21:12:11,459 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36465] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithMergeRegion" procId is: 57 2023-07-15 21:12:11,459 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-15 21:12:11,459 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36465] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-15 21:12:11,462 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/38967c9fac58073db9cd7c3d8c65764f 2023-07-15 21:12:11,462 DEBUG [HFileArchiver-16] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/232d1bc0cd1672f160a30b34098a567c 2023-07-15 21:12:11,463 DEBUG [HFileArchiver-15] backup.HFileArchiver(153): Directory hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/38967c9fac58073db9cd7c3d8c65764f empty. 2023-07-15 21:12:11,463 DEBUG [HFileArchiver-16] backup.HFileArchiver(153): Directory hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/232d1bc0cd1672f160a30b34098a567c empty. 2023-07-15 21:12:11,463 DEBUG [HFileArchiver-15] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/38967c9fac58073db9cd7c3d8c65764f 2023-07-15 21:12:11,463 DEBUG [HFileArchiver-16] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/232d1bc0cd1672f160a30b34098a567c 2023-07-15 21:12:11,463 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion regions 2023-07-15 21:12:11,473 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/.tabledesc/.tableinfo.0000000001 2023-07-15 21:12:11,474 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(7675): creating {ENCODED => 38967c9fac58073db9cd7c3d8c65764f, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1689455531454.38967c9fac58073db9cd7c3d8c65764f.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/.tmp 2023-07-15 21:12:11,475 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(7675): creating {ENCODED => 232d1bc0cd1672f160a30b34098a567c, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1689455531454.232d1bc0cd1672f160a30b34098a567c.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/.tmp 2023-07-15 21:12:11,487 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,,1689455531454.38967c9fac58073db9cd7c3d8c65764f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-15 21:12:11,487 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1604): Closing 38967c9fac58073db9cd7c3d8c65764f, disabling compactions & flushes 2023-07-15 21:12:11,487 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,,1689455531454.38967c9fac58073db9cd7c3d8c65764f. 2023-07-15 21:12:11,487 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,,1689455531454.38967c9fac58073db9cd7c3d8c65764f. 2023-07-15 21:12:11,487 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,,1689455531454.38967c9fac58073db9cd7c3d8c65764f. after waiting 0 ms 2023-07-15 21:12:11,487 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,,1689455531454.38967c9fac58073db9cd7c3d8c65764f. 2023-07-15 21:12:11,487 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,,1689455531454.38967c9fac58073db9cd7c3d8c65764f. 2023-07-15 21:12:11,487 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1558): Region close journal for 38967c9fac58073db9cd7c3d8c65764f: 2023-07-15 21:12:11,496 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,1,1689455531454.232d1bc0cd1672f160a30b34098a567c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-15 21:12:11,496 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1604): Closing 232d1bc0cd1672f160a30b34098a567c, disabling compactions & flushes 2023-07-15 21:12:11,496 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,1,1689455531454.232d1bc0cd1672f160a30b34098a567c. 2023-07-15 21:12:11,496 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1689455531454.232d1bc0cd1672f160a30b34098a567c. 2023-07-15 21:12:11,496 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1689455531454.232d1bc0cd1672f160a30b34098a567c. after waiting 0 ms 2023-07-15 21:12:11,496 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,1,1689455531454.232d1bc0cd1672f160a30b34098a567c. 2023-07-15 21:12:11,496 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,1,1689455531454.232d1bc0cd1672f160a30b34098a567c. 2023-07-15 21:12:11,496 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1558): Region close journal for 232d1bc0cd1672f160a30b34098a567c: 2023-07-15 21:12:11,499 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_ADD_TO_META 2023-07-15 21:12:11,500 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689455531454.38967c9fac58073db9cd7c3d8c65764f.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689455531500"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689455531500"}]},"ts":"1689455531500"} 2023-07-15 21:12:11,500 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689455531454.232d1bc0cd1672f160a30b34098a567c.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689455531500"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689455531500"}]},"ts":"1689455531500"} 2023-07-15 21:12:11,506 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-15 21:12:11,507 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-15 21:12:11,508 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689455531508"}]},"ts":"1689455531508"} 2023-07-15 21:12:11,509 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=ENABLING in hbase:meta 2023-07-15 21:12:11,514 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-15 21:12:11,515 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-15 21:12:11,515 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-15 21:12:11,515 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-15 21:12:11,515 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-15 21:12:11,515 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=38967c9fac58073db9cd7c3d8c65764f, ASSIGN}, {pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=232d1bc0cd1672f160a30b34098a567c, ASSIGN}] 2023-07-15 21:12:11,517 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=232d1bc0cd1672f160a30b34098a567c, ASSIGN 2023-07-15 21:12:11,517 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=38967c9fac58073db9cd7c3d8c65764f, ASSIGN 2023-07-15 21:12:11,518 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=232d1bc0cd1672f160a30b34098a567c, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,37853,1689455451932; forceNewPlan=false, retain=false 2023-07-15 21:12:11,518 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=38967c9fac58073db9cd7c3d8c65764f, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,39587,1689455451998; forceNewPlan=false, retain=false 2023-07-15 21:12:11,561 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36465] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-15 21:12:11,668 INFO [jenkins-hbase4:36465] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-15 21:12:11,671 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=58 updating hbase:meta row=38967c9fac58073db9cd7c3d8c65764f, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,39587,1689455451998 2023-07-15 21:12:11,671 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=59 updating hbase:meta row=232d1bc0cd1672f160a30b34098a567c, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,37853,1689455451932 2023-07-15 21:12:11,671 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689455531454.38967c9fac58073db9cd7c3d8c65764f.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689455531671"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689455531671"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689455531671"}]},"ts":"1689455531671"} 2023-07-15 21:12:11,671 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689455531454.232d1bc0cd1672f160a30b34098a567c.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689455531671"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689455531671"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689455531671"}]},"ts":"1689455531671"} 2023-07-15 21:12:11,673 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=60, ppid=58, state=RUNNABLE; OpenRegionProcedure 38967c9fac58073db9cd7c3d8c65764f, server=jenkins-hbase4.apache.org,39587,1689455451998}] 2023-07-15 21:12:11,675 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=61, ppid=59, state=RUNNABLE; OpenRegionProcedure 232d1bc0cd1672f160a30b34098a567c, server=jenkins-hbase4.apache.org,37853,1689455451932}] 2023-07-15 21:12:11,762 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36465] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-15 21:12:11,830 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion,,1689455531454.38967c9fac58073db9cd7c3d8c65764f. 2023-07-15 21:12:11,830 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 38967c9fac58073db9cd7c3d8c65764f, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1689455531454.38967c9fac58073db9cd7c3d8c65764f.', STARTKEY => '', ENDKEY => '1'} 2023-07-15 21:12:11,831 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion,,1689455531454.38967c9fac58073db9cd7c3d8c65764f. service=AccessControlService 2023-07-15 21:12:11,831 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-15 21:12:11,831 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion 38967c9fac58073db9cd7c3d8c65764f 2023-07-15 21:12:11,831 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,,1689455531454.38967c9fac58073db9cd7c3d8c65764f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-15 21:12:11,831 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 38967c9fac58073db9cd7c3d8c65764f 2023-07-15 21:12:11,831 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 38967c9fac58073db9cd7c3d8c65764f 2023-07-15 21:12:11,833 INFO [StoreOpener-38967c9fac58073db9cd7c3d8c65764f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 38967c9fac58073db9cd7c3d8c65764f 2023-07-15 21:12:11,834 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion,1,1689455531454.232d1bc0cd1672f160a30b34098a567c. 2023-07-15 21:12:11,835 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 232d1bc0cd1672f160a30b34098a567c, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1689455531454.232d1bc0cd1672f160a30b34098a567c.', STARTKEY => '1', ENDKEY => ''} 2023-07-15 21:12:11,835 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion,1,1689455531454.232d1bc0cd1672f160a30b34098a567c. service=AccessControlService 2023-07-15 21:12:11,835 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-15 21:12:11,835 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion 232d1bc0cd1672f160a30b34098a567c 2023-07-15 21:12:11,835 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,1,1689455531454.232d1bc0cd1672f160a30b34098a567c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-15 21:12:11,835 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 232d1bc0cd1672f160a30b34098a567c 2023-07-15 21:12:11,835 DEBUG [StoreOpener-38967c9fac58073db9cd7c3d8c65764f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/data/default/testtb-testExportFileSystemStateWithMergeRegion/38967c9fac58073db9cd7c3d8c65764f/cf 2023-07-15 21:12:11,835 DEBUG [StoreOpener-38967c9fac58073db9cd7c3d8c65764f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/data/default/testtb-testExportFileSystemStateWithMergeRegion/38967c9fac58073db9cd7c3d8c65764f/cf 2023-07-15 21:12:11,835 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 232d1bc0cd1672f160a30b34098a567c 2023-07-15 21:12:11,837 INFO [StoreOpener-38967c9fac58073db9cd7c3d8c65764f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 38967c9fac58073db9cd7c3d8c65764f columnFamilyName cf 2023-07-15 21:12:11,838 INFO [StoreOpener-38967c9fac58073db9cd7c3d8c65764f-1] regionserver.HStore(310): Store=38967c9fac58073db9cd7c3d8c65764f/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-15 21:12:11,845 INFO [StoreOpener-232d1bc0cd1672f160a30b34098a567c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 232d1bc0cd1672f160a30b34098a567c 2023-07-15 21:12:11,846 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/data/default/testtb-testExportFileSystemStateWithMergeRegion/38967c9fac58073db9cd7c3d8c65764f 2023-07-15 21:12:11,846 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/data/default/testtb-testExportFileSystemStateWithMergeRegion/38967c9fac58073db9cd7c3d8c65764f 2023-07-15 21:12:11,847 DEBUG [StoreOpener-232d1bc0cd1672f160a30b34098a567c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/data/default/testtb-testExportFileSystemStateWithMergeRegion/232d1bc0cd1672f160a30b34098a567c/cf 2023-07-15 21:12:11,847 DEBUG [StoreOpener-232d1bc0cd1672f160a30b34098a567c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/data/default/testtb-testExportFileSystemStateWithMergeRegion/232d1bc0cd1672f160a30b34098a567c/cf 2023-07-15 21:12:11,847 INFO [StoreOpener-232d1bc0cd1672f160a30b34098a567c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 232d1bc0cd1672f160a30b34098a567c columnFamilyName cf 2023-07-15 21:12:11,852 INFO [StoreOpener-232d1bc0cd1672f160a30b34098a567c-1] regionserver.HStore(310): Store=232d1bc0cd1672f160a30b34098a567c/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-15 21:12:11,853 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/data/default/testtb-testExportFileSystemStateWithMergeRegion/232d1bc0cd1672f160a30b34098a567c 2023-07-15 21:12:11,854 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/data/default/testtb-testExportFileSystemStateWithMergeRegion/232d1bc0cd1672f160a30b34098a567c 2023-07-15 21:12:11,854 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 38967c9fac58073db9cd7c3d8c65764f 2023-07-15 21:12:11,858 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 232d1bc0cd1672f160a30b34098a567c 2023-07-15 21:12:11,858 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/data/default/testtb-testExportFileSystemStateWithMergeRegion/38967c9fac58073db9cd7c3d8c65764f/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-15 21:12:11,859 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 38967c9fac58073db9cd7c3d8c65764f; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60260512, jitterRate=-0.10204839706420898}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-15 21:12:11,859 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 38967c9fac58073db9cd7c3d8c65764f: 2023-07-15 21:12:11,861 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/data/default/testtb-testExportFileSystemStateWithMergeRegion/232d1bc0cd1672f160a30b34098a567c/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-15 21:12:11,862 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 232d1bc0cd1672f160a30b34098a567c; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73802996, jitterRate=0.0997503399848938}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-15 21:12:11,862 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 232d1bc0cd1672f160a30b34098a567c: 2023-07-15 21:12:11,862 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion,,1689455531454.38967c9fac58073db9cd7c3d8c65764f., pid=60, masterSystemTime=1689455531825 2023-07-15 21:12:11,863 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion,1,1689455531454.232d1bc0cd1672f160a30b34098a567c., pid=61, masterSystemTime=1689455531827 2023-07-15 21:12:11,867 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion,,1689455531454.38967c9fac58073db9cd7c3d8c65764f. 2023-07-15 21:12:11,867 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion,,1689455531454.38967c9fac58073db9cd7c3d8c65764f. 2023-07-15 21:12:11,868 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=58 updating hbase:meta row=38967c9fac58073db9cd7c3d8c65764f, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,39587,1689455451998 2023-07-15 21:12:11,868 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689455531454.38967c9fac58073db9cd7c3d8c65764f.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689455531868"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689455531868"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689455531868"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689455531868"}]},"ts":"1689455531868"} 2023-07-15 21:12:11,869 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=59 updating hbase:meta row=232d1bc0cd1672f160a30b34098a567c, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,37853,1689455451932 2023-07-15 21:12:11,869 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion,1,1689455531454.232d1bc0cd1672f160a30b34098a567c. 2023-07-15 21:12:11,869 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion,1,1689455531454.232d1bc0cd1672f160a30b34098a567c. 2023-07-15 21:12:11,869 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689455531454.232d1bc0cd1672f160a30b34098a567c.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689455531869"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689455531869"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689455531869"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689455531869"}]},"ts":"1689455531869"} 2023-07-15 21:12:11,873 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=60, resume processing ppid=58 2023-07-15 21:12:11,874 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=60, ppid=58, state=SUCCESS; OpenRegionProcedure 38967c9fac58073db9cd7c3d8c65764f, server=jenkins-hbase4.apache.org,39587,1689455451998 in 197 msec 2023-07-15 21:12:11,875 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=61, resume processing ppid=59 2023-07-15 21:12:11,875 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=61, ppid=59, state=SUCCESS; OpenRegionProcedure 232d1bc0cd1672f160a30b34098a567c, server=jenkins-hbase4.apache.org,37853,1689455451932 in 197 msec 2023-07-15 21:12:11,876 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=58, ppid=57, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=38967c9fac58073db9cd7c3d8c65764f, ASSIGN in 358 msec 2023-07-15 21:12:11,878 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=59, resume processing ppid=57 2023-07-15 21:12:11,878 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=59, ppid=57, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=232d1bc0cd1672f160a30b34098a567c, ASSIGN in 360 msec 2023-07-15 21:12:11,880 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-15 21:12:11,880 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689455531880"}]},"ts":"1689455531880"} 2023-07-15 21:12:11,882 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=ENABLED in hbase:meta 2023-07-15 21:12:11,885 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_POST_OPERATION 2023-07-15 21:12:11,885 DEBUG [PEWorker-5] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithMergeRegion jenkins: RWXCA 2023-07-15 21:12:11,887 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=39075] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-07-15 21:12:11,889 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): regionserver:39587-0x1016ad2d8bb0002, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 21:12:11,889 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): master:36465-0x1016ad2d8bb0000, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 21:12:11,889 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): regionserver:39075-0x1016ad2d8bb0003, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 21:12:11,889 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): regionserver:37853-0x1016ad2d8bb0001, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 21:12:11,891 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-15 21:12:11,891 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-15 21:12:11,891 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-15 21:12:11,891 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-15 21:12:11,893 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=57, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 436 msec 2023-07-15 21:12:12,063 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36465] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-15 21:12:12,064 INFO [Listener at jenkins-hbase4.apache.org/41711] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 57 completed 2023-07-15 21:12:12,067 DEBUG [Listener at jenkins-hbase4.apache.org/41711] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithMergeRegion 2023-07-15 21:12:12,067 DEBUG [Listener at jenkins-hbase4.apache.org/41711] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithMergeRegion,,1689455531454.38967c9fac58073db9cd7c3d8c65764f. 2023-07-15 21:12:12,069 INFO [Listener at jenkins-hbase4.apache.org/41711] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-15 21:12:12,086 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36465] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-15 21:12:12,086 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36465] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689455532086 (current time:1689455532086). 2023-07-15 21:12:12,086 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36465] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-15 21:12:12,087 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36465] zookeeper.ReadOnlyZKClient(139): Connect 0x468be0c4 to 127.0.0.1:50024 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-15 21:12:12,095 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36465] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@a43d517, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-15 21:12:12,097 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36465] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-15 21:12:12,101 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:40266, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-15 21:12:12,102 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36465] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x468be0c4 to 127.0.0.1:50024 2023-07-15 21:12:12,102 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36465] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-15 21:12:12,103 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36465] zookeeper.ReadOnlyZKClient(139): Connect 0x3b6a643d to 127.0.0.1:50024 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-15 21:12:12,109 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36465] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@227e2e54, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-15 21:12:12,115 DEBUG [hconnection-0x3681bc61-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-15 21:12:12,116 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:40268, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-15 21:12:12,122 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36465] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3b6a643d to 127.0.0.1:50024 2023-07-15 21:12:12,122 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36465] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-15 21:12:12,122 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36465] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-07-15 21:12:12,123 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36465] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-15 21:12:12,124 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36465] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-15 21:12:12,126 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36465] procedure2.ProcedureExecutor(1029): Stored pid=62, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-15 21:12:12,127 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=62, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-15 21:12:12,128 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=62, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE; timeout=600000, timestamp=1689456132128 2023-07-15 21:12:12,128 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion 2023-07-15 21:12:12,128 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36465] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-15 21:12:12,130 DEBUG [Listener at jenkins-hbase4.apache.org/41711] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-15 21:12:12,130 DEBUG [Listener at jenkins-hbase4.apache.org/41711] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-15 21:12:12,130 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=63, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-15 21:12:12,131 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=62, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-15 21:12:12,132 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=62, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE in 6 msec 2023-07-15 21:12:12,133 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=63, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-15 21:12:12,133 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=63, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED; timeout=600000, timestamp=1689456132133 2023-07-15 21:12:12,143 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 21:12:12,143 INFO [(jenkins-hbase4.apache.org,36465,1689455450507)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' 2023-07-15 21:12:12,143 DEBUG [(jenkins-hbase4.apache.org,36465,1689455450507)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 21:12:12,144 DEBUG [(jenkins-hbase4.apache.org,36465,1689455450507)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' 2023-07-15 21:12:12,144 DEBUG [(jenkins-hbase4.apache.org,36465,1689455450507)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion', kicking off acquire phase on members. 2023-07-15 21:12:12,145 DEBUG [(jenkins-hbase4.apache.org,36465,1689455450507)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36465-0x1016ad2d8bb0000, quorum=127.0.0.1:50024, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 21:12:12,145 DEBUG [(jenkins-hbase4.apache.org,36465,1689455450507)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 21:12:12,147 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): regionserver:37853-0x1016ad2d8bb0001, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 21:12:12,147 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): regionserver:39075-0x1016ad2d8bb0003, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 21:12:12,147 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 21:12:12,147 DEBUG [(jenkins-hbase4.apache.org,36465,1689455450507)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39587,1689455451998 2023-07-15 21:12:12,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 21:12:12,147 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 21:12:12,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 21:12:12,147 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): regionserver:39587-0x1016ad2d8bb0002, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 21:12:12,147 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 21:12:12,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 21:12:12,147 DEBUG [(jenkins-hbase4.apache.org,36465,1689455450507)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36465-0x1016ad2d8bb0000, quorum=127.0.0.1:50024, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39587,1689455451998 2023-07-15 21:12:12,147 DEBUG [(jenkins-hbase4.apache.org,36465,1689455450507)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37853,1689455451932 2023-07-15 21:12:12,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 21:12:12,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 21:12:12,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 21:12:12,148 DEBUG [(jenkins-hbase4.apache.org,36465,1689455450507)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36465-0x1016ad2d8bb0000, quorum=127.0.0.1:50024, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37853,1689455451932 2023-07-15 21:12:12,148 DEBUG [(jenkins-hbase4.apache.org,36465,1689455450507)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-15 21:12:12,148 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39075-0x1016ad2d8bb0003, quorum=127.0.0.1:50024, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 21:12:12,148 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37853-0x1016ad2d8bb0001, quorum=127.0.0.1:50024, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 21:12:12,148 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39587-0x1016ad2d8bb0002, quorum=127.0.0.1:50024, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 21:12:12,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-07-15 21:12:12,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 21:12:12,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-07-15 21:12:12,149 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 21:12:12,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-07-15 21:12:12,149 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 21:12:12,149 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-15 21:12:12,149 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-15 21:12:12,149 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-15 21:12:12,149 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 21:12:12,149 DEBUG [member: 'jenkins-hbase4.apache.org,39587,1689455451998' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-15 21:12:12,149 DEBUG [member: 'jenkins-hbase4.apache.org,39587,1689455451998' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 21:12:12,150 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 21:12:12,152 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 21:12:12,152 DEBUG [member: 'jenkins-hbase4.apache.org,39075,1689455452043' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-15 21:12:12,152 DEBUG [member: 'jenkins-hbase4.apache.org,39075,1689455452043' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 21:12:12,152 DEBUG [member: 'jenkins-hbase4.apache.org,39587,1689455451998' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-15 21:12:12,153 DEBUG [member: 'jenkins-hbase4.apache.org,39075,1689455452043' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-15 21:12:12,153 DEBUG [member: 'jenkins-hbase4.apache.org,39587,1689455451998' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-15 21:12:12,153 DEBUG [member: 'jenkins-hbase4.apache.org,39587,1689455451998' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39587,1689455451998' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-15 21:12:12,152 DEBUG [member: 'jenkins-hbase4.apache.org,37853,1689455451932' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-15 21:12:12,153 DEBUG [member: 'jenkins-hbase4.apache.org,39075,1689455452043' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-15 21:12:12,153 DEBUG [member: 'jenkins-hbase4.apache.org,39075,1689455452043' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39075,1689455452043' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-15 21:12:12,153 DEBUG [member: 'jenkins-hbase4.apache.org,37853,1689455451932' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 21:12:12,154 DEBUG [member: 'jenkins-hbase4.apache.org,37853,1689455451932' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-15 21:12:12,154 DEBUG [member: 'jenkins-hbase4.apache.org,37853,1689455451932' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-15 21:12:12,154 DEBUG [member: 'jenkins-hbase4.apache.org,37853,1689455451932' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37853,1689455451932' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-15 21:12:12,156 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): master:36465-0x1016ad2d8bb0000, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39587,1689455451998 2023-07-15 21:12:12,156 DEBUG [member: 'jenkins-hbase4.apache.org,39587,1689455451998' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 21:12:12,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39587,1689455451998 2023-07-15 21:12:12,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 21:12:12,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 21:12:12,157 DEBUG [member: 'jenkins-hbase4.apache.org,39075,1689455452043' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 21:12:12,157 DEBUG [member: 'jenkins-hbase4.apache.org,37853,1689455451932' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 21:12:12,157 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 21:12:12,157 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): master:36465-0x1016ad2d8bb0000, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37853,1689455451932 2023-07-15 21:12:12,157 DEBUG [member: 'jenkins-hbase4.apache.org,39075,1689455452043' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39075-0x1016ad2d8bb0003, quorum=127.0.0.1:50024, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 21:12:12,158 DEBUG [member: 'jenkins-hbase4.apache.org,39075,1689455452043' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-15 21:12:12,157 DEBUG [member: 'jenkins-hbase4.apache.org,39587,1689455451998' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39587-0x1016ad2d8bb0002, quorum=127.0.0.1:50024, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 21:12:12,158 DEBUG [member: 'jenkins-hbase4.apache.org,39587,1689455451998' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-15 21:12:12,158 DEBUG [member: 'jenkins-hbase4.apache.org,37853,1689455451932' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37853-0x1016ad2d8bb0001, quorum=127.0.0.1:50024, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 21:12:12,158 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 21:12:12,158 DEBUG [member: 'jenkins-hbase4.apache.org,37853,1689455451932' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-15 21:12:12,158 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 21:12:12,158 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39075,1689455452043 2023-07-15 21:12:12,159 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39587,1689455451998 2023-07-15 21:12:12,159 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37853,1689455451932 2023-07-15 21:12:12,159 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 21:12:12,160 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39587,1689455451998' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-07-15 21:12:12,160 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1a2cc012[Count = 1] remaining members to acquire global barrier 2023-07-15 21:12:12,160 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37853,1689455451932 2023-07-15 21:12:12,160 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 21:12:12,160 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 21:12:12,160 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 21:12:12,161 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 21:12:12,161 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 21:12:12,161 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39075,1689455452043 2023-07-15 21:12:12,161 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39587,1689455451998 2023-07-15 21:12:12,162 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37853,1689455451932 2023-07-15 21:12:12,162 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 21:12:12,162 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37853,1689455451932' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-07-15 21:12:12,162 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1a2cc012[Count = 0] remaining members to acquire global barrier 2023-07-15 21:12:12,162 DEBUG [(jenkins-hbase4.apache.org,36465,1689455450507)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'in-barrier' execution. 2023-07-15 21:12:12,162 DEBUG [(jenkins-hbase4.apache.org,36465,1689455450507)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 21:12:12,164 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): regionserver:39587-0x1016ad2d8bb0002, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 21:12:12,164 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 21:12:12,164 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): regionserver:39075-0x1016ad2d8bb0003, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 21:12:12,164 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): regionserver:37853-0x1016ad2d8bb0001, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 21:12:12,164 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 21:12:12,164 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 21:12:12,164 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 21:12:12,164 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 21:12:12,164 DEBUG [member: 'jenkins-hbase4.apache.org,37853,1689455451932' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-15 21:12:12,164 DEBUG [(jenkins-hbase4.apache.org,36465,1689455450507)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36465-0x1016ad2d8bb0000, quorum=127.0.0.1:50024, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39587,1689455451998 2023-07-15 21:12:12,164 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 21:12:12,164 DEBUG [member: 'jenkins-hbase4.apache.org,39587,1689455451998' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-15 21:12:12,165 DEBUG [member: 'jenkins-hbase4.apache.org,37853,1689455451932' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-15 21:12:12,165 DEBUG [member: 'jenkins-hbase4.apache.org,37853,1689455451932' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-15 21:12:12,165 DEBUG [member: 'jenkins-hbase4.apache.org,39075,1689455452043' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-15 21:12:12,165 DEBUG [member: 'jenkins-hbase4.apache.org,39075,1689455452043' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-15 21:12:12,165 DEBUG [rs(jenkins-hbase4.apache.org,37853,1689455451932)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1689455531454.232d1bc0cd1672f160a30b34098a567c. 2023-07-15 21:12:12,165 DEBUG [member: 'jenkins-hbase4.apache.org,39587,1689455451998' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-15 21:12:12,165 DEBUG [rs(jenkins-hbase4.apache.org,37853,1689455451932)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1689455531454.232d1bc0cd1672f160a30b34098a567c. started... 2023-07-15 21:12:12,165 DEBUG [member: 'jenkins-hbase4.apache.org,39587,1689455451998' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-15 21:12:12,165 DEBUG [rs(jenkins-hbase4.apache.org,39587,1689455451998)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1689455531454.38967c9fac58073db9cd7c3d8c65764f. 2023-07-15 21:12:12,165 DEBUG [(jenkins-hbase4.apache.org,36465,1689455450507)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36465-0x1016ad2d8bb0000, quorum=127.0.0.1:50024, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37853,1689455451932 2023-07-15 21:12:12,166 DEBUG [(jenkins-hbase4.apache.org,36465,1689455450507)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-15 21:12:12,165 DEBUG [member: 'jenkins-hbase4.apache.org,39075,1689455452043' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,39075,1689455452043' in zk 2023-07-15 21:12:12,166 DEBUG [rs(jenkins-hbase4.apache.org,37853,1689455451932)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 232d1bc0cd1672f160a30b34098a567c: 2023-07-15 21:12:12,166 DEBUG [rs(jenkins-hbase4.apache.org,39587,1689455451998)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1689455531454.38967c9fac58073db9cd7c3d8c65764f. started... 2023-07-15 21:12:12,166 DEBUG [rs(jenkins-hbase4.apache.org,37853,1689455451932)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,1,1689455531454.232d1bc0cd1672f160a30b34098a567c.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 21:12:12,167 DEBUG [rs(jenkins-hbase4.apache.org,39587,1689455451998)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 38967c9fac58073db9cd7c3d8c65764f: 2023-07-15 21:12:12,167 DEBUG [rs(jenkins-hbase4.apache.org,37853,1689455451932)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-15 21:12:12,167 DEBUG [rs(jenkins-hbase4.apache.org,37853,1689455451932)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-15 21:12:12,167 DEBUG [rs(jenkins-hbase4.apache.org,39587,1689455451998)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,,1689455531454.38967c9fac58073db9cd7c3d8c65764f.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 21:12:12,167 DEBUG [rs(jenkins-hbase4.apache.org,39587,1689455451998)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-15 21:12:12,167 DEBUG [rs(jenkins-hbase4.apache.org,39587,1689455451998)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-15 21:12:12,171 DEBUG [member: 'jenkins-hbase4.apache.org,39075,1689455452043' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-15 21:12:12,171 DEBUG [member: 'jenkins-hbase4.apache.org,39075,1689455452043' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 21:12:12,171 DEBUG [member: 'jenkins-hbase4.apache.org,39075,1689455452043' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-15 21:12:12,194 DEBUG [rs(jenkins-hbase4.apache.org,37853,1689455451932)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1689455531454.232d1bc0cd1672f160a30b34098a567c. completed. 2023-07-15 21:12:12,194 DEBUG [rs(jenkins-hbase4.apache.org,37853,1689455451932)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1689455531454.232d1bc0cd1672f160a30b34098a567c. 2023-07-15 21:12:12,194 DEBUG [member: 'jenkins-hbase4.apache.org,37853,1689455451932' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-15 21:12:12,194 DEBUG [member: 'jenkins-hbase4.apache.org,37853,1689455451932' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-15 21:12:12,194 DEBUG [member: 'jenkins-hbase4.apache.org,37853,1689455451932' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,37853,1689455451932 2023-07-15 21:12:12,195 DEBUG [member: 'jenkins-hbase4.apache.org,37853,1689455451932' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-15 21:12:12,195 DEBUG [member: 'jenkins-hbase4.apache.org,37853,1689455451932' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,37853,1689455451932' in zk 2023-07-15 21:12:12,196 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): master:36465-0x1016ad2d8bb0000, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37853,1689455451932 2023-07-15 21:12:12,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37853,1689455451932 2023-07-15 21:12:12,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 21:12:12,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 21:12:12,196 DEBUG [member: 'jenkins-hbase4.apache.org,37853,1689455451932' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-15 21:12:12,197 DEBUG [member: 'jenkins-hbase4.apache.org,37853,1689455451932' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 21:12:12,197 DEBUG [rs(jenkins-hbase4.apache.org,39587,1689455451998)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1689455531454.38967c9fac58073db9cd7c3d8c65764f. completed. 2023-07-15 21:12:12,199 DEBUG [rs(jenkins-hbase4.apache.org,39587,1689455451998)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1689455531454.38967c9fac58073db9cd7c3d8c65764f. 2023-07-15 21:12:12,197 DEBUG [member: 'jenkins-hbase4.apache.org,37853,1689455451932' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-15 21:12:12,199 DEBUG [member: 'jenkins-hbase4.apache.org,39587,1689455451998' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-15 21:12:12,199 DEBUG [member: 'jenkins-hbase4.apache.org,39587,1689455451998' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-15 21:12:12,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 21:12:12,199 DEBUG [member: 'jenkins-hbase4.apache.org,39587,1689455451998' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,39587,1689455451998 2023-07-15 21:12:12,199 DEBUG [member: 'jenkins-hbase4.apache.org,39587,1689455451998' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-15 21:12:12,199 DEBUG [member: 'jenkins-hbase4.apache.org,39587,1689455451998' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,39587,1689455451998' in zk 2023-07-15 21:12:12,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 21:12:12,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 21:12:12,202 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): master:36465-0x1016ad2d8bb0000, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39587,1689455451998 2023-07-15 21:12:12,202 DEBUG [member: 'jenkins-hbase4.apache.org,39587,1689455451998' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-15 21:12:12,202 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39075,1689455452043 2023-07-15 21:12:12,202 DEBUG [member: 'jenkins-hbase4.apache.org,39587,1689455451998' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 21:12:12,202 DEBUG [member: 'jenkins-hbase4.apache.org,39587,1689455451998' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-15 21:12:12,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39587,1689455451998 2023-07-15 21:12:12,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37853,1689455451932 2023-07-15 21:12:12,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 21:12:12,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 21:12:12,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39075,1689455452043 2023-07-15 21:12:12,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39587,1689455451998 2023-07-15 21:12:12,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37853,1689455451932 2023-07-15 21:12:12,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,37853,1689455451932': 2023-07-15 21:12:12,207 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37853,1689455451932' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 1 more 2023-07-15 21:12:12,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39587,1689455451998 2023-07-15 21:12:12,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 21:12:12,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 21:12:12,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 21:12:12,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 21:12:12,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 21:12:12,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39075,1689455452043 2023-07-15 21:12:12,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39587,1689455451998 2023-07-15 21:12:12,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37853,1689455451932 2023-07-15 21:12:12,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 21:12:12,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 21:12:12,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39075,1689455452043 2023-07-15 21:12:12,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39587,1689455451998 2023-07-15 21:12:12,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37853,1689455451932 2023-07-15 21:12:12,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,39587,1689455451998': 2023-07-15 21:12:12,210 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39587,1689455451998' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 0 more 2023-07-15 21:12:12,210 INFO [(jenkins-hbase4.apache.org,36465,1689455450507)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' execution completed 2023-07-15 21:12:12,210 DEBUG [(jenkins-hbase4.apache.org,36465,1689455450507)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-15 21:12:12,211 DEBUG [(jenkins-hbase4.apache.org,36465,1689455450507)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-15 21:12:12,211 DEBUG [(jenkins-hbase4.apache.org,36465,1689455450507)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 21:12:12,211 INFO [(jenkins-hbase4.apache.org,36465,1689455450507)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateWithMergeRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-15 21:12:12,212 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): master:36465-0x1016ad2d8bb0000, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 21:12:12,212 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): regionserver:39075-0x1016ad2d8bb0003, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 21:12:12,212 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): regionserver:39587-0x1016ad2d8bb0002, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 21:12:12,213 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 21:12:12,213 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): regionserver:39075-0x1016ad2d8bb0003, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 21:12:12,212 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 21:12:12,213 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 21:12:12,213 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 21:12:12,212 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): regionserver:37853-0x1016ad2d8bb0001, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 21:12:12,213 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 21:12:12,213 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 21:12:12,213 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 21:12:12,213 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): regionserver:39587-0x1016ad2d8bb0002, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 21:12:12,213 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): regionserver:37853-0x1016ad2d8bb0001, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 21:12:12,213 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 21:12:12,213 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 21:12:12,213 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 21:12:12,213 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 21:12:12,213 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 21:12:12,213 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 21:12:12,213 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 21:12:12,213 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 21:12:12,214 DEBUG [(jenkins-hbase4.apache.org,36465,1689455450507)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36465-0x1016ad2d8bb0000, quorum=127.0.0.1:50024, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39075,1689455452043 2023-07-15 21:12:12,214 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 21:12:12,213 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 21:12:12,214 DEBUG [(jenkins-hbase4.apache.org,36465,1689455450507)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36465-0x1016ad2d8bb0000, quorum=127.0.0.1:50024, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39587,1689455451998 2023-07-15 21:12:12,214 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 21:12:12,214 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 21:12:12,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 21:12:12,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 21:12:12,215 DEBUG [(jenkins-hbase4.apache.org,36465,1689455450507)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36465-0x1016ad2d8bb0000, quorum=127.0.0.1:50024, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37853,1689455451932 2023-07-15 21:12:12,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 21:12:12,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39075,1689455452043 2023-07-15 21:12:12,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39587,1689455451998 2023-07-15 21:12:12,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37853,1689455451932 2023-07-15 21:12:12,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 21:12:12,217 DEBUG [(jenkins-hbase4.apache.org,36465,1689455450507)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36465-0x1016ad2d8bb0000, quorum=127.0.0.1:50024, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39075,1689455452043 2023-07-15 21:12:12,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 21:12:12,217 DEBUG [(jenkins-hbase4.apache.org,36465,1689455450507)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36465-0x1016ad2d8bb0000, quorum=127.0.0.1:50024, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39587,1689455451998 2023-07-15 21:12:12,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39075,1689455452043 2023-07-15 21:12:12,217 DEBUG [(jenkins-hbase4.apache.org,36465,1689455450507)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36465-0x1016ad2d8bb0000, quorum=127.0.0.1:50024, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37853,1689455451932 2023-07-15 21:12:12,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39587,1689455451998 2023-07-15 21:12:12,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37853,1689455451932 2023-07-15 21:12:12,220 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): master:36465-0x1016ad2d8bb0000, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37853,1689455451932 2023-07-15 21:12:12,221 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): master:36465-0x1016ad2d8bb0000, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 21:12:12,221 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): master:36465-0x1016ad2d8bb0000, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39587,1689455451998 2023-07-15 21:12:12,221 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): regionserver:39587-0x1016ad2d8bb0002, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 21:12:12,221 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): regionserver:37853-0x1016ad2d8bb0001, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 21:12:12,221 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): regionserver:39075-0x1016ad2d8bb0003, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 21:12:12,221 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): regionserver:37853-0x1016ad2d8bb0001, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 21:12:12,221 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): regionserver:39075-0x1016ad2d8bb0003, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 21:12:12,221 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): master:36465-0x1016ad2d8bb0000, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39075,1689455452043 2023-07-15 21:12:12,221 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 21:12:12,221 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 21:12:12,221 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 21:12:12,221 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 21:12:12,221 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 21:12:12,221 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 21:12:12,221 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): regionserver:39587-0x1016ad2d8bb0002, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 21:12:12,221 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithMergeRegion 2023-07-15 21:12:12,221 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 21:12:12,221 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => aaca68e56e63a701f5c1ec9dc2f0511c, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,.mob,0.aaca68e56e63a701f5c1ec9dc2f0511c.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 21:12:12,221 DEBUG [(jenkins-hbase4.apache.org,36465,1689455450507)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 21:12:12,221 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 21:12:12,221 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): master:36465-0x1016ad2d8bb0000, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 21:12:12,221 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-15 21:12:12,221 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 21:12:12,223 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): master:36465-0x1016ad2d8bb0000, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37853,1689455451932 2023-07-15 21:12:12,223 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 21:12:12,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 21:12:12,223 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): master:36465-0x1016ad2d8bb0000, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 21:12:12,223 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): master:36465-0x1016ad2d8bb0000, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39587,1689455451998 2023-07-15 21:12:12,223 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): master:36465-0x1016ad2d8bb0000, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39075,1689455452043 2023-07-15 21:12:12,224 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): master:36465-0x1016ad2d8bb0000, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 21:12:12,224 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): master:36465-0x1016ad2d8bb0000, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 21:12:12,224 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 21:12:12,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 21:12:12,224 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-07-15 21:12:12,230 DEBUG [Listener at jenkins-hbase4.apache.org/41711] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-15 21:12:12,233 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36465] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-15 21:12:12,233 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36465] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-15 21:12:12,233 DEBUG [Listener at jenkins-hbase4.apache.org/41711] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-15 21:12:12,236 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 21:12:12,237 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 21:12:12,266 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion to hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/.hbase-snapshot/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 21:12:12,286 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed 2023-07-15 21:12:12,286 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 21:12:12,286 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 21:12:12,286 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion at 1689455532128Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithMergeRegion at 1689455532236 (+108 ms)Consolidate snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1689455532236Loading Region manifests for emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1689455532236Writing data manifest for emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1689455532242 (+6 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1689455532256 (+14 ms)Snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed at 1689455532286 (+30 ms) 2023-07-15 21:12:12,289 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=63, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-15 21:12:12,290 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=63, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED in 160 msec 2023-07-15 21:12:12,320 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithMergeRegion' 2023-07-15 21:12:12,433 DEBUG [Listener at jenkins-hbase4.apache.org/41711] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-15 21:12:12,434 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36465] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-15 21:12:12,434 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36465] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-15 21:12:12,437 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39587] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithMergeRegion,,1689455531454.38967c9fac58073db9cd7c3d8c65764f. with WAL disabled. Data may be lost in the event of a crash. 2023-07-15 21:12:12,438 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37853] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithMergeRegion,1,1689455531454.232d1bc0cd1672f160a30b34098a567c. with WAL disabled. Data may be lost in the event of a crash. 2023-07-15 21:12:12,442 DEBUG [Listener at jenkins-hbase4.apache.org/41711] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithMergeRegion 2023-07-15 21:12:12,442 DEBUG [Listener at jenkins-hbase4.apache.org/41711] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithMergeRegion,,1689455531454.38967c9fac58073db9cd7c3d8c65764f. 2023-07-15 21:12:12,442 INFO [Listener at jenkins-hbase4.apache.org/41711] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-15 21:12:12,452 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36465] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-15 21:12:12,452 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36465] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689455532452 (current time:1689455532452). 2023-07-15 21:12:12,452 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36465] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-15 21:12:12,453 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36465] zookeeper.ReadOnlyZKClient(139): Connect 0x7b7a54d6 to 127.0.0.1:50024 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-15 21:12:12,460 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36465] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7e3305d3, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-15 21:12:12,462 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36465] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-15 21:12:12,465 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:40270, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-15 21:12:12,466 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36465] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7b7a54d6 to 127.0.0.1:50024 2023-07-15 21:12:12,466 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36465] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-15 21:12:12,467 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36465] zookeeper.ReadOnlyZKClient(139): Connect 0x514669b5 to 127.0.0.1:50024 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-15 21:12:12,472 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36465] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@78334baf, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-15 21:12:12,474 DEBUG [hconnection-0x1ec8c4e7-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-15 21:12:12,477 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:40284, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-15 21:12:12,483 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36465] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x514669b5 to 127.0.0.1:50024 2023-07-15 21:12:12,483 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36465] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-15 21:12:12,483 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36465] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-07-15 21:12:12,484 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36465] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-15 21:12:12,484 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36465] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-15 21:12:12,487 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36465] procedure2.ProcedureExecutor(1029): Stored pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-15 21:12:12,488 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-15 21:12:12,488 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=64, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE; timeout=600000, timestamp=1689456132488 2023-07-15 21:12:12,488 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion 2023-07-15 21:12:12,488 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36465] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-15 21:12:12,490 DEBUG [Listener at jenkins-hbase4.apache.org/41711] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-15 21:12:12,490 DEBUG [Listener at jenkins-hbase4.apache.org/41711] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-15 21:12:12,491 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=64, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-15 21:12:12,491 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=65, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-15 21:12:12,492 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=64, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE in 5 msec 2023-07-15 21:12:12,493 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=65, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-15 21:12:12,494 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=65, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED; timeout=600000, timestamp=1689456132494 2023-07-15 21:12:12,507 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 21:12:12,507 INFO [(jenkins-hbase4.apache.org,36465,1689455450507)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' 2023-07-15 21:12:12,507 DEBUG [(jenkins-hbase4.apache.org,36465,1689455450507)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 21:12:12,508 DEBUG [(jenkins-hbase4.apache.org,36465,1689455450507)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' 2023-07-15 21:12:12,508 DEBUG [(jenkins-hbase4.apache.org,36465,1689455450507)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion', kicking off acquire phase on members. 2023-07-15 21:12:12,508 DEBUG [(jenkins-hbase4.apache.org,36465,1689455450507)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36465-0x1016ad2d8bb0000, quorum=127.0.0.1:50024, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 21:12:12,508 DEBUG [(jenkins-hbase4.apache.org,36465,1689455450507)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 21:12:12,510 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): regionserver:39587-0x1016ad2d8bb0002, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 21:12:12,510 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): regionserver:39075-0x1016ad2d8bb0003, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 21:12:12,510 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 21:12:12,510 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 21:12:12,510 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 21:12:12,510 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 21:12:12,510 DEBUG [(jenkins-hbase4.apache.org,36465,1689455450507)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39587,1689455451998 2023-07-15 21:12:12,510 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): regionserver:37853-0x1016ad2d8bb0001, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 21:12:12,510 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 21:12:12,510 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 21:12:12,510 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 21:12:12,510 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 21:12:12,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 21:12:12,511 DEBUG [(jenkins-hbase4.apache.org,36465,1689455450507)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36465-0x1016ad2d8bb0000, quorum=127.0.0.1:50024, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39587,1689455451998 2023-07-15 21:12:12,511 DEBUG [(jenkins-hbase4.apache.org,36465,1689455450507)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37853,1689455451932 2023-07-15 21:12:12,511 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39075-0x1016ad2d8bb0003, quorum=127.0.0.1:50024, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 21:12:12,511 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37853-0x1016ad2d8bb0001, quorum=127.0.0.1:50024, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 21:12:12,511 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39587-0x1016ad2d8bb0002, quorum=127.0.0.1:50024, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 21:12:12,511 DEBUG [(jenkins-hbase4.apache.org,36465,1689455450507)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36465-0x1016ad2d8bb0000, quorum=127.0.0.1:50024, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37853,1689455451932 2023-07-15 21:12:12,511 DEBUG [(jenkins-hbase4.apache.org,36465,1689455450507)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-15 21:12:12,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-07-15 21:12:12,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-07-15 21:12:12,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-07-15 21:12:12,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 21:12:12,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 21:12:12,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 21:12:12,512 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-15 21:12:12,512 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-15 21:12:12,512 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-15 21:12:12,512 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 21:12:12,512 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 21:12:12,512 DEBUG [member: 'jenkins-hbase4.apache.org,37853,1689455451932' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-15 21:12:12,512 DEBUG [member: 'jenkins-hbase4.apache.org,39587,1689455451998' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-15 21:12:12,512 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 21:12:12,512 DEBUG [member: 'jenkins-hbase4.apache.org,39587,1689455451998' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 21:12:12,512 DEBUG [member: 'jenkins-hbase4.apache.org,39075,1689455452043' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-15 21:12:12,512 DEBUG [member: 'jenkins-hbase4.apache.org,39075,1689455452043' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 21:12:12,512 DEBUG [member: 'jenkins-hbase4.apache.org,37853,1689455451932' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 21:12:12,514 DEBUG [member: 'jenkins-hbase4.apache.org,39075,1689455452043' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-15 21:12:12,515 DEBUG [member: 'jenkins-hbase4.apache.org,39075,1689455452043' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-15 21:12:12,513 DEBUG [member: 'jenkins-hbase4.apache.org,39587,1689455451998' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-15 21:12:12,515 DEBUG [member: 'jenkins-hbase4.apache.org,39075,1689455452043' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39075,1689455452043' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-15 21:12:12,515 DEBUG [member: 'jenkins-hbase4.apache.org,37853,1689455451932' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-15 21:12:12,515 DEBUG [member: 'jenkins-hbase4.apache.org,37853,1689455451932' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-15 21:12:12,515 DEBUG [member: 'jenkins-hbase4.apache.org,39587,1689455451998' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-15 21:12:12,516 DEBUG [member: 'jenkins-hbase4.apache.org,39587,1689455451998' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39587,1689455451998' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-15 21:12:12,516 DEBUG [member: 'jenkins-hbase4.apache.org,37853,1689455451932' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37853,1689455451932' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-15 21:12:12,518 DEBUG [member: 'jenkins-hbase4.apache.org,39075,1689455452043' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 21:12:12,519 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): master:36465-0x1016ad2d8bb0000, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39587,1689455451998 2023-07-15 21:12:12,519 DEBUG [member: 'jenkins-hbase4.apache.org,37853,1689455451932' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 21:12:12,519 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): master:36465-0x1016ad2d8bb0000, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37853,1689455451932 2023-07-15 21:12:12,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39587,1689455451998 2023-07-15 21:12:12,519 DEBUG [member: 'jenkins-hbase4.apache.org,39075,1689455452043' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39075-0x1016ad2d8bb0003, quorum=127.0.0.1:50024, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 21:12:12,519 DEBUG [member: 'jenkins-hbase4.apache.org,39075,1689455452043' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-15 21:12:12,519 DEBUG [member: 'jenkins-hbase4.apache.org,39587,1689455451998' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 21:12:12,519 DEBUG [member: 'jenkins-hbase4.apache.org,37853,1689455451932' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37853-0x1016ad2d8bb0001, quorum=127.0.0.1:50024, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 21:12:12,519 DEBUG [member: 'jenkins-hbase4.apache.org,37853,1689455451932' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-15 21:12:12,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 21:12:12,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 21:12:12,519 DEBUG [member: 'jenkins-hbase4.apache.org,39587,1689455451998' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39587-0x1016ad2d8bb0002, quorum=127.0.0.1:50024, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 21:12:12,519 DEBUG [member: 'jenkins-hbase4.apache.org,39587,1689455451998' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-15 21:12:12,520 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 21:12:12,520 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 21:12:12,520 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 21:12:12,520 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39075,1689455452043 2023-07-15 21:12:12,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39587,1689455451998 2023-07-15 21:12:12,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37853,1689455451932 2023-07-15 21:12:12,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 21:12:12,521 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39587,1689455451998' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-07-15 21:12:12,521 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@101a5071[Count = 1] remaining members to acquire global barrier 2023-07-15 21:12:12,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37853,1689455451932 2023-07-15 21:12:12,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 21:12:12,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 21:12:12,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 21:12:12,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 21:12:12,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 21:12:12,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39075,1689455452043 2023-07-15 21:12:12,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39587,1689455451998 2023-07-15 21:12:12,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37853,1689455451932 2023-07-15 21:12:12,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 21:12:12,523 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37853,1689455451932' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-07-15 21:12:12,523 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@101a5071[Count = 0] remaining members to acquire global barrier 2023-07-15 21:12:12,523 DEBUG [(jenkins-hbase4.apache.org,36465,1689455450507)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'in-barrier' execution. 2023-07-15 21:12:12,523 DEBUG [(jenkins-hbase4.apache.org,36465,1689455450507)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 21:12:12,525 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): regionserver:39075-0x1016ad2d8bb0003, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 21:12:12,525 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): regionserver:39587-0x1016ad2d8bb0002, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 21:12:12,525 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): regionserver:37853-0x1016ad2d8bb0001, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 21:12:12,525 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 21:12:12,525 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 21:12:12,525 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 21:12:12,525 DEBUG [(jenkins-hbase4.apache.org,36465,1689455450507)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36465-0x1016ad2d8bb0000, quorum=127.0.0.1:50024, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39587,1689455451998 2023-07-15 21:12:12,525 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 21:12:12,525 DEBUG [member: 'jenkins-hbase4.apache.org,39587,1689455451998' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-15 21:12:12,525 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 21:12:12,525 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 21:12:12,525 DEBUG [member: 'jenkins-hbase4.apache.org,39587,1689455451998' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-15 21:12:12,525 DEBUG [member: 'jenkins-hbase4.apache.org,37853,1689455451932' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-15 21:12:12,525 DEBUG [rs(jenkins-hbase4.apache.org,39587,1689455451998)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1689455531454.38967c9fac58073db9cd7c3d8c65764f. 2023-07-15 21:12:12,525 DEBUG [member: 'jenkins-hbase4.apache.org,39075,1689455452043' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-15 21:12:12,525 DEBUG [rs(jenkins-hbase4.apache.org,39587,1689455451998)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1689455531454.38967c9fac58073db9cd7c3d8c65764f. started... 2023-07-15 21:12:12,525 DEBUG [member: 'jenkins-hbase4.apache.org,39075,1689455452043' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-15 21:12:12,525 DEBUG [member: 'jenkins-hbase4.apache.org,37853,1689455451932' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-15 21:12:12,525 DEBUG [member: 'jenkins-hbase4.apache.org,37853,1689455451932' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-15 21:12:12,525 DEBUG [rs(jenkins-hbase4.apache.org,37853,1689455451932)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1689455531454.232d1bc0cd1672f160a30b34098a567c. 2023-07-15 21:12:12,525 DEBUG [(jenkins-hbase4.apache.org,36465,1689455450507)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36465-0x1016ad2d8bb0000, quorum=127.0.0.1:50024, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37853,1689455451932 2023-07-15 21:12:12,526 DEBUG [rs(jenkins-hbase4.apache.org,37853,1689455451932)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1689455531454.232d1bc0cd1672f160a30b34098a567c. started... 2023-07-15 21:12:12,525 DEBUG [member: 'jenkins-hbase4.apache.org,39587,1689455451998' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-15 21:12:12,526 DEBUG [(jenkins-hbase4.apache.org,36465,1689455450507)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-15 21:12:12,525 INFO [rs(jenkins-hbase4.apache.org,39587,1689455451998)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 38967c9fac58073db9cd7c3d8c65764f 1/1 column families, dataSize=132 B heapSize=544 B 2023-07-15 21:12:12,525 DEBUG [member: 'jenkins-hbase4.apache.org,39075,1689455452043' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,39075,1689455452043' in zk 2023-07-15 21:12:12,526 INFO [rs(jenkins-hbase4.apache.org,37853,1689455451932)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 232d1bc0cd1672f160a30b34098a567c 1/1 column families, dataSize=3.13 KB heapSize=7 KB 2023-07-15 21:12:12,527 DEBUG [member: 'jenkins-hbase4.apache.org,39075,1689455452043' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-15 21:12:12,527 DEBUG [member: 'jenkins-hbase4.apache.org,39075,1689455452043' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 21:12:12,527 DEBUG [member: 'jenkins-hbase4.apache.org,39075,1689455452043' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-15 21:12:12,550 INFO [rs(jenkins-hbase4.apache.org,37853,1689455451932)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023071568b1093a674c45868f7ddc13b198deb5 to hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b2023071568b1093a674c45868f7ddc13b198deb5 2023-07-15 21:12:12,553 INFO [rs(jenkins-hbase4.apache.org,39587,1689455451998)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202307151455e4b008c7430bbc85cd80ca3fabf4 to hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e202307151455e4b008c7430bbc85cd80ca3fabf4 2023-07-15 21:12:12,567 INFO [rs(jenkins-hbase4.apache.org,37853,1689455451932)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/data/default/testtb-testExportFileSystemStateWithMergeRegion/232d1bc0cd1672f160a30b34098a567c/.tmp/cf/20604d0d408944858330cd14680154e8 2023-07-15 21:12:12,578 DEBUG [rs(jenkins-hbase4.apache.org,37853,1689455451932)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/data/default/testtb-testExportFileSystemStateWithMergeRegion/232d1bc0cd1672f160a30b34098a567c/.tmp/cf/20604d0d408944858330cd14680154e8 as hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/data/default/testtb-testExportFileSystemStateWithMergeRegion/232d1bc0cd1672f160a30b34098a567c/cf/20604d0d408944858330cd14680154e8 2023-07-15 21:12:12,581 INFO [rs(jenkins-hbase4.apache.org,39587,1689455451998)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=132, hasBloomFilter=true, into tmp file hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/data/default/testtb-testExportFileSystemStateWithMergeRegion/38967c9fac58073db9cd7c3d8c65764f/.tmp/cf/562dc122e35645ae8dd1a5ca19bf18e6 2023-07-15 21:12:12,584 INFO [rs(jenkins-hbase4.apache.org,37853,1689455451932)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/data/default/testtb-testExportFileSystemStateWithMergeRegion/232d1bc0cd1672f160a30b34098a567c/cf/20604d0d408944858330cd14680154e8, entries=48, sequenceid=6, filesize=13.7 K 2023-07-15 21:12:12,585 INFO [rs(jenkins-hbase4.apache.org,37853,1689455451932)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.13 KB/3204, heapSize ~6.98 KB/7152, currentSize=0 B/0 for 232d1bc0cd1672f160a30b34098a567c in 59ms, sequenceid=6, compaction requested=false 2023-07-15 21:12:12,587 DEBUG [rs(jenkins-hbase4.apache.org,37853,1689455451932)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 232d1bc0cd1672f160a30b34098a567c: 2023-07-15 21:12:12,587 DEBUG [rs(jenkins-hbase4.apache.org,37853,1689455451932)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,1,1689455531454.232d1bc0cd1672f160a30b34098a567c.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 21:12:12,588 DEBUG [rs(jenkins-hbase4.apache.org,37853,1689455451932)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-15 21:12:12,588 DEBUG [rs(jenkins-hbase4.apache.org,37853,1689455451932)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/data/default/testtb-testExportFileSystemStateWithMergeRegion/232d1bc0cd1672f160a30b34098a567c/cf/20604d0d408944858330cd14680154e8] hfiles 2023-07-15 21:12:12,588 DEBUG [rs(jenkins-hbase4.apache.org,37853,1689455451932)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/data/default/testtb-testExportFileSystemStateWithMergeRegion/232d1bc0cd1672f160a30b34098a567c/cf/20604d0d408944858330cd14680154e8 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 21:12:12,589 DEBUG [rs(jenkins-hbase4.apache.org,39587,1689455451998)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/data/default/testtb-testExportFileSystemStateWithMergeRegion/38967c9fac58073db9cd7c3d8c65764f/.tmp/cf/562dc122e35645ae8dd1a5ca19bf18e6 as hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/data/default/testtb-testExportFileSystemStateWithMergeRegion/38967c9fac58073db9cd7c3d8c65764f/cf/562dc122e35645ae8dd1a5ca19bf18e6 2023-07-15 21:12:12,590 DEBUG [Listener at jenkins-hbase4.apache.org/41711] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-15 21:12:12,591 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36465] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-15 21:12:12,591 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36465] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-15 21:12:12,591 DEBUG [Listener at jenkins-hbase4.apache.org/41711] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-15 21:12:12,595 INFO [rs(jenkins-hbase4.apache.org,39587,1689455451998)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/data/default/testtb-testExportFileSystemStateWithMergeRegion/38967c9fac58073db9cd7c3d8c65764f/cf/562dc122e35645ae8dd1a5ca19bf18e6, entries=2, sequenceid=6, filesize=5.3 K 2023-07-15 21:12:12,598 DEBUG [rs(jenkins-hbase4.apache.org,37853,1689455451932)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1689455531454.232d1bc0cd1672f160a30b34098a567c. completed. 2023-07-15 21:12:12,598 DEBUG [rs(jenkins-hbase4.apache.org,37853,1689455451932)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1689455531454.232d1bc0cd1672f160a30b34098a567c. 2023-07-15 21:12:12,598 DEBUG [member: 'jenkins-hbase4.apache.org,37853,1689455451932' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-15 21:12:12,598 INFO [rs(jenkins-hbase4.apache.org,39587,1689455451998)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~132 B/132, heapSize ~528 B/528, currentSize=0 B/0 for 38967c9fac58073db9cd7c3d8c65764f in 73ms, sequenceid=6, compaction requested=false 2023-07-15 21:12:12,598 DEBUG [member: 'jenkins-hbase4.apache.org,37853,1689455451932' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-15 21:12:12,598 DEBUG [member: 'jenkins-hbase4.apache.org,37853,1689455451932' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,37853,1689455451932 2023-07-15 21:12:12,598 DEBUG [rs(jenkins-hbase4.apache.org,39587,1689455451998)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 38967c9fac58073db9cd7c3d8c65764f: 2023-07-15 21:12:12,598 DEBUG [member: 'jenkins-hbase4.apache.org,37853,1689455451932' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-15 21:12:12,598 DEBUG [member: 'jenkins-hbase4.apache.org,37853,1689455451932' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,37853,1689455451932' in zk 2023-07-15 21:12:12,598 DEBUG [rs(jenkins-hbase4.apache.org,39587,1689455451998)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,,1689455531454.38967c9fac58073db9cd7c3d8c65764f.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 21:12:12,598 DEBUG [rs(jenkins-hbase4.apache.org,39587,1689455451998)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-15 21:12:12,599 DEBUG [rs(jenkins-hbase4.apache.org,39587,1689455451998)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/data/default/testtb-testExportFileSystemStateWithMergeRegion/38967c9fac58073db9cd7c3d8c65764f/cf/562dc122e35645ae8dd1a5ca19bf18e6] hfiles 2023-07-15 21:12:12,599 DEBUG [rs(jenkins-hbase4.apache.org,39587,1689455451998)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/data/default/testtb-testExportFileSystemStateWithMergeRegion/38967c9fac58073db9cd7c3d8c65764f/cf/562dc122e35645ae8dd1a5ca19bf18e6 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 21:12:12,603 DEBUG [member: 'jenkins-hbase4.apache.org,37853,1689455451932' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-15 21:12:12,603 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): master:36465-0x1016ad2d8bb0000, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37853,1689455451932 2023-07-15 21:12:12,603 DEBUG [member: 'jenkins-hbase4.apache.org,37853,1689455451932' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 21:12:12,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37853,1689455451932 2023-07-15 21:12:12,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 21:12:12,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 21:12:12,604 DEBUG [member: 'jenkins-hbase4.apache.org,37853,1689455451932' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-15 21:12:12,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 21:12:12,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 21:12:12,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 21:12:12,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39075,1689455452043 2023-07-15 21:12:12,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39587,1689455451998 2023-07-15 21:12:12,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37853,1689455451932 2023-07-15 21:12:12,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 21:12:12,608 DEBUG [rs(jenkins-hbase4.apache.org,39587,1689455451998)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1689455531454.38967c9fac58073db9cd7c3d8c65764f. completed. 2023-07-15 21:12:12,608 DEBUG [rs(jenkins-hbase4.apache.org,39587,1689455451998)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1689455531454.38967c9fac58073db9cd7c3d8c65764f. 2023-07-15 21:12:12,608 DEBUG [member: 'jenkins-hbase4.apache.org,39587,1689455451998' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-15 21:12:12,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 21:12:12,609 DEBUG [member: 'jenkins-hbase4.apache.org,39587,1689455451998' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-15 21:12:12,609 DEBUG [member: 'jenkins-hbase4.apache.org,39587,1689455451998' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,39587,1689455451998 2023-07-15 21:12:12,609 DEBUG [member: 'jenkins-hbase4.apache.org,39587,1689455451998' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-15 21:12:12,609 DEBUG [member: 'jenkins-hbase4.apache.org,39587,1689455451998' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,39587,1689455451998' in zk 2023-07-15 21:12:12,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39075,1689455452043 2023-07-15 21:12:12,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37853,1689455451932 2023-07-15 21:12:12,610 DEBUG [member: 'jenkins-hbase4.apache.org,39587,1689455451998' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-15 21:12:12,611 DEBUG [member: 'jenkins-hbase4.apache.org,39587,1689455451998' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 21:12:12,611 DEBUG [member: 'jenkins-hbase4.apache.org,39587,1689455451998' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-15 21:12:12,610 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): master:36465-0x1016ad2d8bb0000, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39587,1689455451998 2023-07-15 21:12:12,612 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,37853,1689455451932': 2023-07-15 21:12:12,612 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37853,1689455451932' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 1 more 2023-07-15 21:12:12,612 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39587,1689455451998 2023-07-15 21:12:12,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 21:12:12,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 21:12:12,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 21:12:12,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 21:12:12,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 21:12:12,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39075,1689455452043 2023-07-15 21:12:12,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39587,1689455451998 2023-07-15 21:12:12,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37853,1689455451932 2023-07-15 21:12:12,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 21:12:12,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 21:12:12,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39075,1689455452043 2023-07-15 21:12:12,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39587,1689455451998 2023-07-15 21:12:12,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37853,1689455451932 2023-07-15 21:12:12,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,39587,1689455451998': 2023-07-15 21:12:12,616 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39587,1689455451998' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 0 more 2023-07-15 21:12:12,616 INFO [(jenkins-hbase4.apache.org,36465,1689455450507)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' execution completed 2023-07-15 21:12:12,617 DEBUG [(jenkins-hbase4.apache.org,36465,1689455450507)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-15 21:12:12,617 DEBUG [(jenkins-hbase4.apache.org,36465,1689455450507)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-15 21:12:12,617 DEBUG [(jenkins-hbase4.apache.org,36465,1689455450507)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 21:12:12,617 INFO [(jenkins-hbase4.apache.org,36465,1689455450507)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithMergeRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-15 21:12:12,621 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): regionserver:39075-0x1016ad2d8bb0003, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 21:12:12,621 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): regionserver:39587-0x1016ad2d8bb0002, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 21:12:12,621 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 21:12:12,621 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 21:12:12,621 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 21:12:12,621 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): master:36465-0x1016ad2d8bb0000, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 21:12:12,621 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): regionserver:39587-0x1016ad2d8bb0002, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 21:12:12,621 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): regionserver:39075-0x1016ad2d8bb0003, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 21:12:12,621 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): regionserver:37853-0x1016ad2d8bb0001, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 21:12:12,621 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 21:12:12,622 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 21:12:12,621 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 21:12:12,622 DEBUG [(jenkins-hbase4.apache.org,36465,1689455450507)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36465-0x1016ad2d8bb0000, quorum=127.0.0.1:50024, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39075,1689455452043 2023-07-15 21:12:12,622 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 21:12:12,622 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 21:12:12,622 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 21:12:12,622 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 21:12:12,622 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): regionserver:37853-0x1016ad2d8bb0001, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 21:12:12,622 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 21:12:12,622 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 21:12:12,622 DEBUG [(jenkins-hbase4.apache.org,36465,1689455450507)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36465-0x1016ad2d8bb0000, quorum=127.0.0.1:50024, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39587,1689455451998 2023-07-15 21:12:12,622 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 21:12:12,622 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 21:12:12,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 21:12:12,623 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 21:12:12,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 21:12:12,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 21:12:12,623 DEBUG [(jenkins-hbase4.apache.org,36465,1689455450507)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36465-0x1016ad2d8bb0000, quorum=127.0.0.1:50024, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37853,1689455451932 2023-07-15 21:12:12,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 21:12:12,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 21:12:12,624 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 21:12:12,624 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 21:12:12,624 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39075,1689455452043 2023-07-15 21:12:12,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39587,1689455451998 2023-07-15 21:12:12,625 DEBUG [(jenkins-hbase4.apache.org,36465,1689455450507)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36465-0x1016ad2d8bb0000, quorum=127.0.0.1:50024, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39075,1689455452043 2023-07-15 21:12:12,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37853,1689455451932 2023-07-15 21:12:12,625 DEBUG [(jenkins-hbase4.apache.org,36465,1689455450507)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36465-0x1016ad2d8bb0000, quorum=127.0.0.1:50024, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39587,1689455451998 2023-07-15 21:12:12,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 21:12:12,626 DEBUG [(jenkins-hbase4.apache.org,36465,1689455450507)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36465-0x1016ad2d8bb0000, quorum=127.0.0.1:50024, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37853,1689455451932 2023-07-15 21:12:12,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 21:12:12,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39075,1689455452043 2023-07-15 21:12:12,627 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39587,1689455451998 2023-07-15 21:12:12,627 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37853,1689455451932 2023-07-15 21:12:12,630 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): master:36465-0x1016ad2d8bb0000, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37853,1689455451932 2023-07-15 21:12:12,630 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): regionserver:39075-0x1016ad2d8bb0003, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 21:12:12,630 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): regionserver:39075-0x1016ad2d8bb0003, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 21:12:12,630 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 21:12:12,631 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): master:36465-0x1016ad2d8bb0000, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 21:12:12,631 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): master:36465-0x1016ad2d8bb0000, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39587,1689455451998 2023-07-15 21:12:12,631 DEBUG [(jenkins-hbase4.apache.org,36465,1689455450507)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 21:12:12,631 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): regionserver:39587-0x1016ad2d8bb0002, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 21:12:12,631 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 21:12:12,631 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): master:36465-0x1016ad2d8bb0000, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39075,1689455452043 2023-07-15 21:12:12,631 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): regionserver:37853-0x1016ad2d8bb0001, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 21:12:12,631 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): regionserver:37853-0x1016ad2d8bb0001, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 21:12:12,633 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 21:12:12,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 21:12:12,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 21:12:12,631 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): master:36465-0x1016ad2d8bb0000, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 21:12:12,631 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithMergeRegion 2023-07-15 21:12:12,631 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 21:12:12,633 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => aaca68e56e63a701f5c1ec9dc2f0511c, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,.mob,0.aaca68e56e63a701f5c1ec9dc2f0511c.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 21:12:12,631 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): regionserver:39587-0x1016ad2d8bb0002, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 21:12:12,633 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-15 21:12:12,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 21:12:12,633 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 21:12:12,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 21:12:12,633 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): master:36465-0x1016ad2d8bb0000, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37853,1689455451932 2023-07-15 21:12:12,634 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 21:12:12,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 21:12:12,634 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 21:12:12,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 21:12:12,634 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): master:36465-0x1016ad2d8bb0000, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 21:12:12,634 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): master:36465-0x1016ad2d8bb0000, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39587,1689455451998 2023-07-15 21:12:12,634 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): master:36465-0x1016ad2d8bb0000, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39075,1689455452043 2023-07-15 21:12:12,634 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): master:36465-0x1016ad2d8bb0000, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 21:12:12,634 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): master:36465-0x1016ad2d8bb0000, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 21:12:12,634 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b2023071568b1093a674c45868f7ddc13b198deb5, hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e202307151455e4b008c7430bbc85cd80ca3fabf4] mob files 2023-07-15 21:12:12,634 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b2023071568b1093a674c45868f7ddc13b198deb5 2023-07-15 21:12:12,634 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e202307151455e4b008c7430bbc85cd80ca3fabf4 2023-07-15 21:12:12,643 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 21:12:12,644 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 21:12:12,663 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion to hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 21:12:12,707 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed 2023-07-15 21:12:12,707 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 21:12:12,707 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 21:12:12,707 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion at 1689455532489Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithMergeRegion at 1689455532643 (+154 ms)Consolidate snapshot: snaptb0-testExportFileSystemStateWithMergeRegion at 1689455532643Loading Region manifests for snaptb0-testExportFileSystemStateWithMergeRegion at 1689455532643Writing data manifest for snaptb0-testExportFileSystemStateWithMergeRegion at 1689455532647 (+4 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithMergeRegion at 1689455532655 (+8 ms)Snapshot snaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed at 1689455532707 (+52 ms) 2023-07-15 21:12:12,710 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=65, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-15 21:12:12,712 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=65, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED in 221 msec 2023-07-15 21:12:12,792 DEBUG [Listener at jenkins-hbase4.apache.org/41711] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-15 21:12:12,793 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36465] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-15 21:12:12,793 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36465] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-15 21:12:12,823 DEBUG [Listener at jenkins-hbase4.apache.org/41711] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-15 21:12:12,827 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:51534, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-15 21:12:12,829 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37853] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-07-15 21:12:12,829 DEBUG [Listener at jenkins-hbase4.apache.org/41711] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-15 21:12:12,835 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:40300, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-15 21:12:12,835 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39075] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-07-15 21:12:12,836 DEBUG [Listener at jenkins-hbase4.apache.org/41711] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-15 21:12:12,840 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:51714, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-15 21:12:12,841 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39587] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-07-15 21:12:12,843 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36465] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-15 21:12:12,844 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36465] procedure2.ProcedureExecutor(1029): Stored pid=66, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-15 21:12:12,846 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_PRE_OPERATION 2023-07-15 21:12:12,846 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36465] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithMergeRegion-1" procId is: 66 2023-07-15 21:12:12,846 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-15 21:12:12,847 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36465] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-15 21:12:12,849 DEBUG [HFileArchiver-17] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d2ca0c75da6ff8bac9cf91aac6774018 2023-07-15 21:12:12,849 DEBUG [HFileArchiver-18] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/5612defd6493d7ed537979c51f83d054 2023-07-15 21:12:12,850 DEBUG [HFileArchiver-17] backup.HFileArchiver(153): Directory hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d2ca0c75da6ff8bac9cf91aac6774018 empty. 2023-07-15 21:12:12,850 DEBUG [HFileArchiver-18] backup.HFileArchiver(153): Directory hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/5612defd6493d7ed537979c51f83d054 empty. 2023-07-15 21:12:12,850 DEBUG [HFileArchiver-17] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d2ca0c75da6ff8bac9cf91aac6774018 2023-07-15 21:12:12,850 DEBUG [HFileArchiver-18] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/5612defd6493d7ed537979c51f83d054 2023-07-15 21:12:12,850 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion-1 regions 2023-07-15 21:12:12,864 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/.tabledesc/.tableinfo.0000000001 2023-07-15 21:12:12,865 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(7675): creating {ENCODED => d2ca0c75da6ff8bac9cf91aac6774018, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1689455532843.d2ca0c75da6ff8bac9cf91aac6774018.', STARTKEY => '', ENDKEY => '2'}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/.tmp 2023-07-15 21:12:12,866 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(7675): creating {ENCODED => 5612defd6493d7ed537979c51f83d054, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,2,1689455532843.5612defd6493d7ed537979c51f83d054.', STARTKEY => '2', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/.tmp 2023-07-15 21:12:12,890 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,2,1689455532843.5612defd6493d7ed537979c51f83d054.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-15 21:12:12,890 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1604): Closing 5612defd6493d7ed537979c51f83d054, disabling compactions & flushes 2023-07-15 21:12:12,890 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,2,1689455532843.5612defd6493d7ed537979c51f83d054. 2023-07-15 21:12:12,890 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1689455532843.5612defd6493d7ed537979c51f83d054. 2023-07-15 21:12:12,891 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1689455532843.5612defd6493d7ed537979c51f83d054. after waiting 0 ms 2023-07-15 21:12:12,891 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,2,1689455532843.5612defd6493d7ed537979c51f83d054. 2023-07-15 21:12:12,891 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,2,1689455532843.5612defd6493d7ed537979c51f83d054. 2023-07-15 21:12:12,891 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1558): Region close journal for 5612defd6493d7ed537979c51f83d054: 2023-07-15 21:12:12,899 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1689455532843.d2ca0c75da6ff8bac9cf91aac6774018.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-15 21:12:12,899 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1604): Closing d2ca0c75da6ff8bac9cf91aac6774018, disabling compactions & flushes 2023-07-15 21:12:12,899 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1689455532843.d2ca0c75da6ff8bac9cf91aac6774018. 2023-07-15 21:12:12,899 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689455532843.d2ca0c75da6ff8bac9cf91aac6774018. 2023-07-15 21:12:12,899 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689455532843.d2ca0c75da6ff8bac9cf91aac6774018. after waiting 0 ms 2023-07-15 21:12:12,899 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1689455532843.d2ca0c75da6ff8bac9cf91aac6774018. 2023-07-15 21:12:12,899 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1689455532843.d2ca0c75da6ff8bac9cf91aac6774018. 2023-07-15 21:12:12,899 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1558): Region close journal for d2ca0c75da6ff8bac9cf91aac6774018: 2023-07-15 21:12:12,907 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_ADD_TO_META 2023-07-15 21:12:12,908 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689455532843.5612defd6493d7ed537979c51f83d054.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689455532908"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689455532908"}]},"ts":"1689455532908"} 2023-07-15 21:12:12,908 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689455532843.d2ca0c75da6ff8bac9cf91aac6774018.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689455532908"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689455532908"}]},"ts":"1689455532908"} 2023-07-15 21:12:12,910 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-15 21:12:12,911 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-15 21:12:12,912 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689455532912"}]},"ts":"1689455532912"} 2023-07-15 21:12:12,913 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=ENABLING in hbase:meta 2023-07-15 21:12:12,916 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-15 21:12:12,918 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-15 21:12:12,918 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-15 21:12:12,918 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-15 21:12:12,918 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-15 21:12:12,918 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=d2ca0c75da6ff8bac9cf91aac6774018, ASSIGN}, {pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=5612defd6493d7ed537979c51f83d054, ASSIGN}] 2023-07-15 21:12:12,921 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=5612defd6493d7ed537979c51f83d054, ASSIGN 2023-07-15 21:12:12,921 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=d2ca0c75da6ff8bac9cf91aac6774018, ASSIGN 2023-07-15 21:12:12,924 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=d2ca0c75da6ff8bac9cf91aac6774018, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,39075,1689455452043; forceNewPlan=false, retain=false 2023-07-15 21:12:12,924 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=5612defd6493d7ed537979c51f83d054, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,37853,1689455451932; forceNewPlan=false, retain=false 2023-07-15 21:12:12,948 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36465] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-15 21:12:13,074 INFO [jenkins-hbase4:36465] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-15 21:12:13,078 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=d2ca0c75da6ff8bac9cf91aac6774018, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,39075,1689455452043 2023-07-15 21:12:13,078 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=68 updating hbase:meta row=5612defd6493d7ed537979c51f83d054, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,37853,1689455451932 2023-07-15 21:12:13,078 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689455532843.d2ca0c75da6ff8bac9cf91aac6774018.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689455533078"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689455533078"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689455533078"}]},"ts":"1689455533078"} 2023-07-15 21:12:13,078 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689455532843.5612defd6493d7ed537979c51f83d054.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689455533078"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689455533078"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689455533078"}]},"ts":"1689455533078"} 2023-07-15 21:12:13,081 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=69, ppid=67, state=RUNNABLE; OpenRegionProcedure d2ca0c75da6ff8bac9cf91aac6774018, server=jenkins-hbase4.apache.org,39075,1689455452043}] 2023-07-15 21:12:13,081 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=70, ppid=68, state=RUNNABLE; OpenRegionProcedure 5612defd6493d7ed537979c51f83d054, server=jenkins-hbase4.apache.org,37853,1689455451932}] 2023-07-15 21:12:13,149 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36465] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-15 21:12:13,241 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,2,1689455532843.5612defd6493d7ed537979c51f83d054. 2023-07-15 21:12:13,241 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 5612defd6493d7ed537979c51f83d054, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,2,1689455532843.5612defd6493d7ed537979c51f83d054.', STARTKEY => '2', ENDKEY => ''} 2023-07-15 21:12:13,241 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,2,1689455532843.5612defd6493d7ed537979c51f83d054. service=AccessControlService 2023-07-15 21:12:13,241 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-15 21:12:13,242 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 5612defd6493d7ed537979c51f83d054 2023-07-15 21:12:13,242 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,2,1689455532843.5612defd6493d7ed537979c51f83d054.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-15 21:12:13,242 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 5612defd6493d7ed537979c51f83d054 2023-07-15 21:12:13,242 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 5612defd6493d7ed537979c51f83d054 2023-07-15 21:12:13,242 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,,1689455532843.d2ca0c75da6ff8bac9cf91aac6774018. 2023-07-15 21:12:13,242 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => d2ca0c75da6ff8bac9cf91aac6774018, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1689455532843.d2ca0c75da6ff8bac9cf91aac6774018.', STARTKEY => '', ENDKEY => '2'} 2023-07-15 21:12:13,242 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,,1689455532843.d2ca0c75da6ff8bac9cf91aac6774018. service=AccessControlService 2023-07-15 21:12:13,242 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-15 21:12:13,243 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 d2ca0c75da6ff8bac9cf91aac6774018 2023-07-15 21:12:13,243 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1689455532843.d2ca0c75da6ff8bac9cf91aac6774018.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-15 21:12:13,243 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for d2ca0c75da6ff8bac9cf91aac6774018 2023-07-15 21:12:13,243 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for d2ca0c75da6ff8bac9cf91aac6774018 2023-07-15 21:12:13,247 INFO [StoreOpener-d2ca0c75da6ff8bac9cf91aac6774018-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region d2ca0c75da6ff8bac9cf91aac6774018 2023-07-15 21:12:13,249 INFO [StoreOpener-5612defd6493d7ed537979c51f83d054-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 5612defd6493d7ed537979c51f83d054 2023-07-15 21:12:13,251 DEBUG [StoreOpener-d2ca0c75da6ff8bac9cf91aac6774018-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d2ca0c75da6ff8bac9cf91aac6774018/cf 2023-07-15 21:12:13,251 DEBUG [StoreOpener-d2ca0c75da6ff8bac9cf91aac6774018-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d2ca0c75da6ff8bac9cf91aac6774018/cf 2023-07-15 21:12:13,251 DEBUG [StoreOpener-5612defd6493d7ed537979c51f83d054-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/5612defd6493d7ed537979c51f83d054/cf 2023-07-15 21:12:13,251 DEBUG [StoreOpener-5612defd6493d7ed537979c51f83d054-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/5612defd6493d7ed537979c51f83d054/cf 2023-07-15 21:12:13,251 INFO [StoreOpener-d2ca0c75da6ff8bac9cf91aac6774018-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d2ca0c75da6ff8bac9cf91aac6774018 columnFamilyName cf 2023-07-15 21:12:13,251 INFO [StoreOpener-5612defd6493d7ed537979c51f83d054-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 5612defd6493d7ed537979c51f83d054 columnFamilyName cf 2023-07-15 21:12:13,253 INFO [StoreOpener-d2ca0c75da6ff8bac9cf91aac6774018-1] regionserver.HStore(310): Store=d2ca0c75da6ff8bac9cf91aac6774018/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-15 21:12:13,254 INFO [StoreOpener-5612defd6493d7ed537979c51f83d054-1] regionserver.HStore(310): Store=5612defd6493d7ed537979c51f83d054/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-15 21:12:13,255 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d2ca0c75da6ff8bac9cf91aac6774018 2023-07-15 21:12:13,255 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/5612defd6493d7ed537979c51f83d054 2023-07-15 21:12:13,256 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/5612defd6493d7ed537979c51f83d054 2023-07-15 21:12:13,256 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d2ca0c75da6ff8bac9cf91aac6774018 2023-07-15 21:12:13,260 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 5612defd6493d7ed537979c51f83d054 2023-07-15 21:12:13,263 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for d2ca0c75da6ff8bac9cf91aac6774018 2023-07-15 21:12:13,264 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/5612defd6493d7ed537979c51f83d054/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-15 21:12:13,265 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 5612defd6493d7ed537979c51f83d054; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71320450, jitterRate=0.06275752186775208}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-15 21:12:13,265 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 5612defd6493d7ed537979c51f83d054: 2023-07-15 21:12:13,266 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,2,1689455532843.5612defd6493d7ed537979c51f83d054., pid=70, masterSystemTime=1689455533236 2023-07-15 21:12:13,267 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d2ca0c75da6ff8bac9cf91aac6774018/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-15 21:12:13,267 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened d2ca0c75da6ff8bac9cf91aac6774018; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64662824, jitterRate=-0.03644883632659912}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-15 21:12:13,268 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for d2ca0c75da6ff8bac9cf91aac6774018: 2023-07-15 21:12:13,268 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,,1689455532843.d2ca0c75da6ff8bac9cf91aac6774018., pid=69, masterSystemTime=1689455533236 2023-07-15 21:12:13,268 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,2,1689455532843.5612defd6493d7ed537979c51f83d054. 2023-07-15 21:12:13,269 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,2,1689455532843.5612defd6493d7ed537979c51f83d054. 2023-07-15 21:12:13,269 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=68 updating hbase:meta row=5612defd6493d7ed537979c51f83d054, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,37853,1689455451932 2023-07-15 21:12:13,269 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689455532843.5612defd6493d7ed537979c51f83d054.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689455533269"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689455533269"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689455533269"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689455533269"}]},"ts":"1689455533269"} 2023-07-15 21:12:13,272 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,,1689455532843.d2ca0c75da6ff8bac9cf91aac6774018. 2023-07-15 21:12:13,272 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,,1689455532843.d2ca0c75da6ff8bac9cf91aac6774018. 2023-07-15 21:12:13,282 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=d2ca0c75da6ff8bac9cf91aac6774018, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,39075,1689455452043 2023-07-15 21:12:13,282 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689455532843.d2ca0c75da6ff8bac9cf91aac6774018.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689455533282"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689455533282"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689455533282"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689455533282"}]},"ts":"1689455533282"} 2023-07-15 21:12:13,284 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=70, resume processing ppid=68 2023-07-15 21:12:13,285 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=70, ppid=68, state=SUCCESS; OpenRegionProcedure 5612defd6493d7ed537979c51f83d054, server=jenkins-hbase4.apache.org,37853,1689455451932 in 192 msec 2023-07-15 21:12:13,287 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=68, ppid=66, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=5612defd6493d7ed537979c51f83d054, ASSIGN in 367 msec 2023-07-15 21:12:13,287 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=69, resume processing ppid=67 2023-07-15 21:12:13,287 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=69, ppid=67, state=SUCCESS; OpenRegionProcedure d2ca0c75da6ff8bac9cf91aac6774018, server=jenkins-hbase4.apache.org,39075,1689455452043 in 203 msec 2023-07-15 21:12:13,289 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=67, resume processing ppid=66 2023-07-15 21:12:13,289 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=67, ppid=66, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=d2ca0c75da6ff8bac9cf91aac6774018, ASSIGN in 369 msec 2023-07-15 21:12:13,290 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-15 21:12:13,291 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689455533290"}]},"ts":"1689455533290"} 2023-07-15 21:12:13,296 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=ENABLED in hbase:meta 2023-07-15 21:12:13,298 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_POST_OPERATION 2023-07-15 21:12:13,299 DEBUG [PEWorker-3] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithMergeRegion-1 jenkins: RWXCA 2023-07-15 21:12:13,302 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=39075] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion-1], kv [jenkins: RWXCA] 2023-07-15 21:12:13,303 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): master:36465-0x1016ad2d8bb0000, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 21:12:13,303 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): regionserver:39587-0x1016ad2d8bb0002, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 21:12:13,303 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): regionserver:37853-0x1016ad2d8bb0001, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 21:12:13,303 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): regionserver:39075-0x1016ad2d8bb0003, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 21:12:13,307 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-15 21:12:13,307 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-15 21:12:13,307 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-07-15 21:12:13,307 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-07-15 21:12:13,308 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-15 21:12:13,308 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-15 21:12:13,308 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-07-15 21:12:13,308 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-07-15 21:12:13,309 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=66, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 464 msec 2023-07-15 21:12:13,451 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36465] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-15 21:12:13,451 INFO [Listener at jenkins-hbase4.apache.org/41711] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 66 completed 2023-07-15 21:12:13,485 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36465] master.HMaster$2(1952): Client=jenkins//172.31.14.131 merge regions d2ca0c75da6ff8bac9cf91aac6774018, 5612defd6493d7ed537979c51f83d054 2023-07-15 21:12:13,498 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36465] procedure2.ProcedureExecutor(1029): Stored pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[d2ca0c75da6ff8bac9cf91aac6774018, 5612defd6493d7ed537979c51f83d054], force=true 2023-07-15 21:12:13,501 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[d2ca0c75da6ff8bac9cf91aac6774018, 5612defd6493d7ed537979c51f83d054], force=true 2023-07-15 21:12:13,501 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[d2ca0c75da6ff8bac9cf91aac6774018, 5612defd6493d7ed537979c51f83d054], force=true 2023-07-15 21:12:13,501 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[d2ca0c75da6ff8bac9cf91aac6774018, 5612defd6493d7ed537979c51f83d054], force=true 2023-07-15 21:12:13,518 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36465] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-15 21:12:13,532 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=d2ca0c75da6ff8bac9cf91aac6774018, UNASSIGN}, {pid=73, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=5612defd6493d7ed537979c51f83d054, UNASSIGN}] 2023-07-15 21:12:13,534 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=d2ca0c75da6ff8bac9cf91aac6774018, UNASSIGN 2023-07-15 21:12:13,534 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=73, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=5612defd6493d7ed537979c51f83d054, UNASSIGN 2023-07-15 21:12:13,535 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=d2ca0c75da6ff8bac9cf91aac6774018, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,39075,1689455452043 2023-07-15 21:12:13,535 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=73 updating hbase:meta row=5612defd6493d7ed537979c51f83d054, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,37853,1689455451932 2023-07-15 21:12:13,535 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689455532843.d2ca0c75da6ff8bac9cf91aac6774018.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689455533535"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689455533535"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689455533535"}]},"ts":"1689455533535"} 2023-07-15 21:12:13,535 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689455532843.5612defd6493d7ed537979c51f83d054.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689455533535"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689455533535"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689455533535"}]},"ts":"1689455533535"} 2023-07-15 21:12:13,537 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=74, ppid=72, state=RUNNABLE; CloseRegionProcedure d2ca0c75da6ff8bac9cf91aac6774018, server=jenkins-hbase4.apache.org,39075,1689455452043}] 2023-07-15 21:12:13,538 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=75, ppid=73, state=RUNNABLE; CloseRegionProcedure 5612defd6493d7ed537979c51f83d054, server=jenkins-hbase4.apache.org,37853,1689455451932}] 2023-07-15 21:12:13,619 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36465] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-15 21:12:13,690 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 5612defd6493d7ed537979c51f83d054 2023-07-15 21:12:13,690 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close d2ca0c75da6ff8bac9cf91aac6774018 2023-07-15 21:12:13,692 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 5612defd6493d7ed537979c51f83d054, disabling compactions & flushes 2023-07-15 21:12:13,692 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,2,1689455532843.5612defd6493d7ed537979c51f83d054. 2023-07-15 21:12:13,693 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing d2ca0c75da6ff8bac9cf91aac6774018, disabling compactions & flushes 2023-07-15 21:12:13,693 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1689455532843.5612defd6493d7ed537979c51f83d054. 2023-07-15 21:12:13,693 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1689455532843.d2ca0c75da6ff8bac9cf91aac6774018. 2023-07-15 21:12:13,693 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1689455532843.5612defd6493d7ed537979c51f83d054. after waiting 0 ms 2023-07-15 21:12:13,693 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,2,1689455532843.5612defd6493d7ed537979c51f83d054. 2023-07-15 21:12:13,693 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689455532843.d2ca0c75da6ff8bac9cf91aac6774018. 2023-07-15 21:12:13,693 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 5612defd6493d7ed537979c51f83d054 1/1 column families, dataSize=24 B heapSize=352 B 2023-07-15 21:12:13,693 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689455532843.d2ca0c75da6ff8bac9cf91aac6774018. after waiting 0 ms 2023-07-15 21:12:13,693 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1689455532843.d2ca0c75da6ff8bac9cf91aac6774018. 2023-07-15 21:12:13,693 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing d2ca0c75da6ff8bac9cf91aac6774018 1/1 column families, dataSize=24 B heapSize=352 B 2023-07-15 21:12:13,724 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=24 B at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/5612defd6493d7ed537979c51f83d054/.tmp/cf/703b611edc7643f783b441b493d5c39c 2023-07-15 21:12:13,726 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=24 B at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d2ca0c75da6ff8bac9cf91aac6774018/.tmp/cf/8b8a7256aca14dabb2f14eed619be8d2 2023-07-15 21:12:13,734 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/5612defd6493d7ed537979c51f83d054/.tmp/cf/703b611edc7643f783b441b493d5c39c as hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/5612defd6493d7ed537979c51f83d054/cf/703b611edc7643f783b441b493d5c39c 2023-07-15 21:12:13,736 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d2ca0c75da6ff8bac9cf91aac6774018/.tmp/cf/8b8a7256aca14dabb2f14eed619be8d2 as hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d2ca0c75da6ff8bac9cf91aac6774018/cf/8b8a7256aca14dabb2f14eed619be8d2 2023-07-15 21:12:13,740 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/5612defd6493d7ed537979c51f83d054/cf/703b611edc7643f783b441b493d5c39c, entries=1, sequenceid=5, filesize=4.7 K 2023-07-15 21:12:13,741 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~24 B/24, heapSize ~336 B/336, currentSize=0 B/0 for 5612defd6493d7ed537979c51f83d054 in 48ms, sequenceid=5, compaction requested=false 2023-07-15 21:12:13,741 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithMergeRegion-1' 2023-07-15 21:12:13,742 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d2ca0c75da6ff8bac9cf91aac6774018/cf/8b8a7256aca14dabb2f14eed619be8d2, entries=1, sequenceid=5, filesize=4.7 K 2023-07-15 21:12:13,742 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~24 B/24, heapSize ~336 B/336, currentSize=0 B/0 for d2ca0c75da6ff8bac9cf91aac6774018 in 49ms, sequenceid=5, compaction requested=false 2023-07-15 21:12:13,752 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/5612defd6493d7ed537979c51f83d054/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-07-15 21:12:13,752 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d2ca0c75da6ff8bac9cf91aac6774018/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-07-15 21:12:13,753 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-15 21:12:13,753 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-15 21:12:13,753 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,2,1689455532843.5612defd6493d7ed537979c51f83d054. 2023-07-15 21:12:13,753 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1689455532843.d2ca0c75da6ff8bac9cf91aac6774018. 2023-07-15 21:12:13,753 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for d2ca0c75da6ff8bac9cf91aac6774018: 2023-07-15 21:12:13,753 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 5612defd6493d7ed537979c51f83d054: 2023-07-15 21:12:13,755 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 5612defd6493d7ed537979c51f83d054 2023-07-15 21:12:13,763 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed d2ca0c75da6ff8bac9cf91aac6774018 2023-07-15 21:12:13,763 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=73 updating hbase:meta row=5612defd6493d7ed537979c51f83d054, regionState=CLOSED 2023-07-15 21:12:13,763 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689455532843.5612defd6493d7ed537979c51f83d054.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689455533763"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689455533763"}]},"ts":"1689455533763"} 2023-07-15 21:12:13,763 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=d2ca0c75da6ff8bac9cf91aac6774018, regionState=CLOSED 2023-07-15 21:12:13,763 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689455532843.d2ca0c75da6ff8bac9cf91aac6774018.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689455533763"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689455533763"}]},"ts":"1689455533763"} 2023-07-15 21:12:13,771 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=75, resume processing ppid=73 2023-07-15 21:12:13,771 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=75, ppid=73, state=SUCCESS; CloseRegionProcedure 5612defd6493d7ed537979c51f83d054, server=jenkins-hbase4.apache.org,37853,1689455451932 in 231 msec 2023-07-15 21:12:13,772 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=74, resume processing ppid=72 2023-07-15 21:12:13,773 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=74, ppid=72, state=SUCCESS; CloseRegionProcedure d2ca0c75da6ff8bac9cf91aac6774018, server=jenkins-hbase4.apache.org,39075,1689455452043 in 232 msec 2023-07-15 21:12:13,774 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=73, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=5612defd6493d7ed537979c51f83d054, UNASSIGN in 241 msec 2023-07-15 21:12:13,776 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=72, resume processing ppid=71 2023-07-15 21:12:13,776 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=72, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=d2ca0c75da6ff8bac9cf91aac6774018, UNASSIGN in 245 msec 2023-07-15 21:12:13,820 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36465] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-15 21:12:13,894 DEBUG [PEWorker-5] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ef509b56e0d66784b01bc975d7880c8d/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=-1 2023-07-15 21:12:13,901 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689455532843.d2ca0c75da6ff8bac9cf91aac6774018.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-07-15 21:12:13,901 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689455532843.5612defd6493d7ed537979c51f83d054.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-07-15 21:12:13,902 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":7,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689455532844.ef509b56e0d66784b01bc975d7880c8d.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"merge0000","vlen":84,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"merge0001","vlen":84,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-07-15 21:12:13,966 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=ef509b56e0d66784b01bc975d7880c8d, ASSIGN}] 2023-07-15 21:12:13,967 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=ef509b56e0d66784b01bc975d7880c8d, ASSIGN 2023-07-15 21:12:13,968 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=ef509b56e0d66784b01bc975d7880c8d, ASSIGN; state=MERGED, location=jenkins-hbase4.apache.org,39075,1689455452043; forceNewPlan=false, retain=false 2023-07-15 21:12:14,119 INFO [jenkins-hbase4:36465] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-07-15 21:12:14,121 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=ef509b56e0d66784b01bc975d7880c8d, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,39075,1689455452043 2023-07-15 21:12:14,121 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689455532844.ef509b56e0d66784b01bc975d7880c8d.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1689455534121"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689455534121"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689455534121"}]},"ts":"1689455534121"} 2023-07-15 21:12:14,122 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36465] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-15 21:12:14,124 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=77, ppid=76, state=RUNNABLE; OpenRegionProcedure ef509b56e0d66784b01bc975d7880c8d, server=jenkins-hbase4.apache.org,39075,1689455452043}] 2023-07-15 21:12:14,280 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,,1689455532844.ef509b56e0d66784b01bc975d7880c8d. 2023-07-15 21:12:14,281 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => ef509b56e0d66784b01bc975d7880c8d, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1689455532844.ef509b56e0d66784b01bc975d7880c8d.', STARTKEY => '', ENDKEY => ''} 2023-07-15 21:12:14,281 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,,1689455532844.ef509b56e0d66784b01bc975d7880c8d. service=AccessControlService 2023-07-15 21:12:14,281 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-15 21:12:14,281 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 ef509b56e0d66784b01bc975d7880c8d 2023-07-15 21:12:14,281 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1689455532844.ef509b56e0d66784b01bc975d7880c8d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-15 21:12:14,282 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for ef509b56e0d66784b01bc975d7880c8d 2023-07-15 21:12:14,282 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for ef509b56e0d66784b01bc975d7880c8d 2023-07-15 21:12:14,283 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(950): Rewriting .regioninfo file at: hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ef509b56e0d66784b01bc975d7880c8d/.regioninfo 2023-07-15 21:12:14,323 INFO [StoreOpener-ef509b56e0d66784b01bc975d7880c8d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region ef509b56e0d66784b01bc975d7880c8d 2023-07-15 21:12:14,324 DEBUG [StoreOpener-ef509b56e0d66784b01bc975d7880c8d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ef509b56e0d66784b01bc975d7880c8d/cf 2023-07-15 21:12:14,324 DEBUG [StoreOpener-ef509b56e0d66784b01bc975d7880c8d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ef509b56e0d66784b01bc975d7880c8d/cf 2023-07-15 21:12:14,325 INFO [StoreOpener-ef509b56e0d66784b01bc975d7880c8d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ef509b56e0d66784b01bc975d7880c8d columnFamilyName cf 2023-07-15 21:12:14,376 DEBUG [StoreOpener-ef509b56e0d66784b01bc975d7880c8d-1] regionserver.HStore(539): loaded hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ef509b56e0d66784b01bc975d7880c8d/cf/703b611edc7643f783b441b493d5c39c.5612defd6493d7ed537979c51f83d054->hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/5612defd6493d7ed537979c51f83d054/cf/703b611edc7643f783b441b493d5c39c-top 2023-07-15 21:12:14,385 DEBUG [StoreOpener-ef509b56e0d66784b01bc975d7880c8d-1] regionserver.HStore(539): loaded hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ef509b56e0d66784b01bc975d7880c8d/cf/8b8a7256aca14dabb2f14eed619be8d2.d2ca0c75da6ff8bac9cf91aac6774018->hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d2ca0c75da6ff8bac9cf91aac6774018/cf/8b8a7256aca14dabb2f14eed619be8d2-top 2023-07-15 21:12:14,386 INFO [StoreOpener-ef509b56e0d66784b01bc975d7880c8d-1] regionserver.HStore(310): Store=ef509b56e0d66784b01bc975d7880c8d/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-15 21:12:14,387 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ef509b56e0d66784b01bc975d7880c8d 2023-07-15 21:12:14,390 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ef509b56e0d66784b01bc975d7880c8d 2023-07-15 21:12:14,395 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for ef509b56e0d66784b01bc975d7880c8d 2023-07-15 21:12:14,397 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened ef509b56e0d66784b01bc975d7880c8d; next sequenceid=9; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74404643, jitterRate=0.10871557891368866}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-15 21:12:14,397 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for ef509b56e0d66784b01bc975d7880c8d: 2023-07-15 21:12:14,398 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,,1689455532844.ef509b56e0d66784b01bc975d7880c8d., pid=77, masterSystemTime=1689455534277 2023-07-15 21:12:14,398 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.CompactSplit(328): Ignoring compaction request for testtb-testExportFileSystemStateWithMergeRegion-1,,1689455532844.ef509b56e0d66784b01bc975d7880c8d.,because compaction is disabled. 2023-07-15 21:12:14,400 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,,1689455532844.ef509b56e0d66784b01bc975d7880c8d. 2023-07-15 21:12:14,400 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,,1689455532844.ef509b56e0d66784b01bc975d7880c8d. 2023-07-15 21:12:14,401 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=ef509b56e0d66784b01bc975d7880c8d, regionState=OPEN, openSeqNum=9, regionLocation=jenkins-hbase4.apache.org,39075,1689455452043 2023-07-15 21:12:14,401 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689455532844.ef509b56e0d66784b01bc975d7880c8d.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1689455534401"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689455534401"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689455534401"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689455534401"}]},"ts":"1689455534401"} 2023-07-15 21:12:14,405 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=77, resume processing ppid=76 2023-07-15 21:12:14,405 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=77, ppid=76, state=SUCCESS; OpenRegionProcedure ef509b56e0d66784b01bc975d7880c8d, server=jenkins-hbase4.apache.org,39075,1689455452043 in 279 msec 2023-07-15 21:12:14,409 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=76, resume processing ppid=71 2023-07-15 21:12:14,409 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=76, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=ef509b56e0d66784b01bc975d7880c8d, ASSIGN in 439 msec 2023-07-15 21:12:14,411 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=71, state=SUCCESS; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[d2ca0c75da6ff8bac9cf91aac6774018, 5612defd6493d7ed537979c51f83d054], force=true in 919 msec 2023-07-15 21:12:14,623 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36465] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-15 21:12:14,624 INFO [Listener at jenkins-hbase4.apache.org/41711] client.HBaseAdmin$TableFuture(3541): Operation: MERGE_REGIONS, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 71 completed 2023-07-15 21:12:14,625 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36465] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-07-15 21:12:14,625 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36465] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689455534625 (current time:1689455534625). 2023-07-15 21:12:14,625 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36465] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-15 21:12:14,625 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36465] zookeeper.ReadOnlyZKClient(139): Connect 0x31b77e86 to 127.0.0.1:50024 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-15 21:12:14,674 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36465] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3f7096c0, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-15 21:12:14,676 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36465] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-15 21:12:14,682 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:40316, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-15 21:12:14,684 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36465] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x31b77e86 to 127.0.0.1:50024 2023-07-15 21:12:14,684 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36465] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-15 21:12:14,684 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36465] zookeeper.ReadOnlyZKClient(139): Connect 0x7e4d9cfb to 127.0.0.1:50024 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-15 21:12:14,712 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36465] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@74049efa, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-15 21:12:14,714 DEBUG [hconnection-0x4f79c02c-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-15 21:12:14,715 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:40326, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-15 21:12:14,721 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36465] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7e4d9cfb to 127.0.0.1:50024 2023-07-15 21:12:14,721 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36465] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-15 21:12:14,722 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36465] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion-1], kv [jenkins: RWXCA] 2023-07-15 21:12:14,722 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36465] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-15 21:12:14,723 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36465] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-07-15 21:12:14,727 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36465] procedure2.ProcedureExecutor(1029): Stored pid=78, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-07-15 21:12:14,729 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=78, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-07-15 21:12:14,737 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=78, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE; timeout=600000, timestamp=1689456134737 2023-07-15 21:12:14,737 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-15 21:12:14,737 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36465] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-07-15 21:12:14,741 DEBUG [Listener at jenkins-hbase4.apache.org/41711] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-15 21:12:14,742 DEBUG [Listener at jenkins-hbase4.apache.org/41711] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-15 21:12:14,743 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=79, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-07-15 21:12:14,743 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=78, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-07-15 21:12:14,746 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=78, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE in 19 msec 2023-07-15 21:12:14,747 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=79, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-07-15 21:12:14,749 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=79, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED; timeout=600000, timestamp=1689456134749 2023-07-15 21:12:14,765 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 21:12:14,765 INFO [(jenkins-hbase4.apache.org,36465,1689455450507)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' 2023-07-15 21:12:14,765 DEBUG [(jenkins-hbase4.apache.org,36465,1689455450507)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 21:12:14,767 DEBUG [(jenkins-hbase4.apache.org,36465,1689455450507)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' 2023-07-15 21:12:14,767 DEBUG [(jenkins-hbase4.apache.org,36465,1689455450507)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1', kicking off acquire phase on members. 2023-07-15 21:12:14,825 DEBUG [(jenkins-hbase4.apache.org,36465,1689455450507)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36465-0x1016ad2d8bb0000, quorum=127.0.0.1:50024, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 21:12:14,825 DEBUG [(jenkins-hbase4.apache.org,36465,1689455450507)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 21:12:14,842 DEBUG [Listener at jenkins-hbase4.apache.org/41711] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-15 21:12:14,842 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): regionserver:39075-0x1016ad2d8bb0003, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 21:12:14,842 DEBUG [(jenkins-hbase4.apache.org,36465,1689455450507)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,39075,1689455452043 2023-07-15 21:12:14,842 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 21:12:14,842 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): regionserver:39587-0x1016ad2d8bb0002, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 21:12:14,842 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): regionserver:37853-0x1016ad2d8bb0001, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 21:12:14,842 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 21:12:14,842 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 21:12:14,842 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 21:12:14,842 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 21:12:14,842 DEBUG [(jenkins-hbase4.apache.org,36465,1689455450507)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36465-0x1016ad2d8bb0000, quorum=127.0.0.1:50024, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,39075,1689455452043 2023-07-15 21:12:14,843 DEBUG [(jenkins-hbase4.apache.org,36465,1689455450507)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-15 21:12:14,842 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 21:12:14,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 21:12:14,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 21:12:14,843 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36465] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } is done 2023-07-15 21:12:14,843 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36465] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }' is still in progress! 2023-07-15 21:12:14,844 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39075-0x1016ad2d8bb0003, quorum=127.0.0.1:50024, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 21:12:14,844 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37853-0x1016ad2d8bb0001, quorum=127.0.0.1:50024, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 21:12:14,844 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 21:12:14,844 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-07-15 21:12:14,844 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-07-15 21:12:14,844 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 21:12:14,844 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 21:12:14,844 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-07-15 21:12:14,845 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-07-15 21:12:14,845 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39587-0x1016ad2d8bb0002, quorum=127.0.0.1:50024, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 21:12:14,845 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-07-15 21:12:14,845 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 21:12:14,845 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-07-15 21:12:14,847 DEBUG [Listener at jenkins-hbase4.apache.org/41711] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-15 21:12:14,849 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 21:12:14,849 DEBUG [member: 'jenkins-hbase4.apache.org,39075,1689455452043' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-07-15 21:12:14,849 DEBUG [member: 'jenkins-hbase4.apache.org,39075,1689455452043' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 21:12:14,850 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 21:12:14,851 DEBUG [member: 'jenkins-hbase4.apache.org,39587,1689455451998' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-07-15 21:12:14,851 DEBUG [member: 'jenkins-hbase4.apache.org,39587,1689455451998' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 21:12:14,857 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 21:12:14,859 DEBUG [member: 'jenkins-hbase4.apache.org,39587,1689455451998' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-07-15 21:12:14,859 DEBUG [member: 'jenkins-hbase4.apache.org,39587,1689455451998' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-07-15 21:12:14,859 DEBUG [member: 'jenkins-hbase4.apache.org,39075,1689455452043' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-07-15 21:12:14,859 DEBUG [member: 'jenkins-hbase4.apache.org,39075,1689455452043' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-07-15 21:12:14,859 DEBUG [member: 'jenkins-hbase4.apache.org,39587,1689455451998' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39587,1689455451998' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-07-15 21:12:14,859 DEBUG [member: 'jenkins-hbase4.apache.org,37853,1689455451932' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-07-15 21:12:14,860 DEBUG [member: 'jenkins-hbase4.apache.org,39075,1689455452043' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39075,1689455452043' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-07-15 21:12:14,860 DEBUG [member: 'jenkins-hbase4.apache.org,37853,1689455451932' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 21:12:14,861 DEBUG [member: 'jenkins-hbase4.apache.org,37853,1689455451932' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-07-15 21:12:14,861 DEBUG [member: 'jenkins-hbase4.apache.org,37853,1689455451932' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-07-15 21:12:14,861 DEBUG [member: 'jenkins-hbase4.apache.org,37853,1689455451932' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37853,1689455451932' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-07-15 21:12:14,863 DEBUG [member: 'jenkins-hbase4.apache.org,39587,1689455451998' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 21:12:14,863 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): master:36465-0x1016ad2d8bb0000, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,39075,1689455452043 2023-07-15 21:12:14,863 DEBUG [member: 'jenkins-hbase4.apache.org,39075,1689455452043' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 21:12:14,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,39075,1689455452043 2023-07-15 21:12:14,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 21:12:14,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 21:12:14,864 DEBUG [member: 'jenkins-hbase4.apache.org,39075,1689455452043' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39075-0x1016ad2d8bb0003, quorum=127.0.0.1:50024, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 21:12:14,864 DEBUG [member: 'jenkins-hbase4.apache.org,37853,1689455451932' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 21:12:14,864 DEBUG [member: 'jenkins-hbase4.apache.org,39075,1689455452043' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-15 21:12:14,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 21:12:14,864 DEBUG [member: 'jenkins-hbase4.apache.org,39587,1689455451998' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39587-0x1016ad2d8bb0002, quorum=127.0.0.1:50024, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 21:12:14,864 DEBUG [member: 'jenkins-hbase4.apache.org,39587,1689455451998' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-15 21:12:14,865 DEBUG [member: 'jenkins-hbase4.apache.org,37853,1689455451932' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37853-0x1016ad2d8bb0001, quorum=127.0.0.1:50024, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 21:12:14,865 DEBUG [member: 'jenkins-hbase4.apache.org,37853,1689455451932' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-15 21:12:14,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 21:12:14,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 21:12:14,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39075,1689455452043 2023-07-15 21:12:14,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39587,1689455451998 2023-07-15 21:12:14,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37853,1689455451932 2023-07-15 21:12:14,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 21:12:14,875 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39075,1689455452043' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' on coordinator 2023-07-15 21:12:14,875 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@70abcc5e[Count = 0] remaining members to acquire global barrier 2023-07-15 21:12:14,875 DEBUG [(jenkins-hbase4.apache.org,36465,1689455450507)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'in-barrier' execution. 2023-07-15 21:12:14,875 DEBUG [(jenkins-hbase4.apache.org,36465,1689455450507)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 21:12:14,883 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): regionserver:39075-0x1016ad2d8bb0003, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 21:12:14,883 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 21:12:14,883 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): regionserver:37853-0x1016ad2d8bb0001, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 21:12:14,883 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): regionserver:39587-0x1016ad2d8bb0002, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 21:12:14,883 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 21:12:14,883 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 21:12:14,884 DEBUG [(jenkins-hbase4.apache.org,36465,1689455450507)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36465-0x1016ad2d8bb0000, quorum=127.0.0.1:50024, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,39075,1689455452043 2023-07-15 21:12:14,884 DEBUG [(jenkins-hbase4.apache.org,36465,1689455450507)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-15 21:12:14,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 21:12:14,884 DEBUG [member: 'jenkins-hbase4.apache.org,39075,1689455452043' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-07-15 21:12:14,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 21:12:14,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 21:12:14,884 DEBUG [member: 'jenkins-hbase4.apache.org,39587,1689455451998' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-07-15 21:12:14,884 DEBUG [member: 'jenkins-hbase4.apache.org,37853,1689455451932' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-07-15 21:12:14,884 DEBUG [member: 'jenkins-hbase4.apache.org,37853,1689455451932' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-07-15 21:12:14,884 DEBUG [member: 'jenkins-hbase4.apache.org,39587,1689455451998' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-07-15 21:12:14,884 DEBUG [member: 'jenkins-hbase4.apache.org,39587,1689455451998' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase4.apache.org,39587,1689455451998' in zk 2023-07-15 21:12:14,884 DEBUG [member: 'jenkins-hbase4.apache.org,37853,1689455451932' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase4.apache.org,37853,1689455451932' in zk 2023-07-15 21:12:14,888 DEBUG [member: 'jenkins-hbase4.apache.org,37853,1689455451932' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-07-15 21:12:14,888 DEBUG [member: 'jenkins-hbase4.apache.org,37853,1689455451932' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 21:12:14,888 DEBUG [member: 'jenkins-hbase4.apache.org,39587,1689455451998' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-07-15 21:12:14,888 DEBUG [member: 'jenkins-hbase4.apache.org,39587,1689455451998' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 21:12:14,888 DEBUG [member: 'jenkins-hbase4.apache.org,37853,1689455451932' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-07-15 21:12:14,888 DEBUG [member: 'jenkins-hbase4.apache.org,39587,1689455451998' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-07-15 21:12:14,889 DEBUG [member: 'jenkins-hbase4.apache.org,39075,1689455452043' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-15 21:12:14,894 DEBUG [member: 'jenkins-hbase4.apache.org,39075,1689455452043' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-15 21:12:14,894 DEBUG [rs(jenkins-hbase4.apache.org,39075,1689455452043)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion-1,,1689455532844.ef509b56e0d66784b01bc975d7880c8d. 2023-07-15 21:12:14,894 DEBUG [rs(jenkins-hbase4.apache.org,39075,1689455452043)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion-1,,1689455532844.ef509b56e0d66784b01bc975d7880c8d. started... 2023-07-15 21:12:14,895 DEBUG [rs(jenkins-hbase4.apache.org,39075,1689455452043)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for ef509b56e0d66784b01bc975d7880c8d: 2023-07-15 21:12:14,896 DEBUG [rs(jenkins-hbase4.apache.org,39075,1689455452043)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion-1,,1689455532844.ef509b56e0d66784b01bc975d7880c8d.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 21:12:14,896 DEBUG [rs(jenkins-hbase4.apache.org,39075,1689455452043)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-15 21:12:14,896 DEBUG [rs(jenkins-hbase4.apache.org,39075,1689455452043)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ef509b56e0d66784b01bc975d7880c8d/cf/703b611edc7643f783b441b493d5c39c.5612defd6493d7ed537979c51f83d054->hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/5612defd6493d7ed537979c51f83d054/cf/703b611edc7643f783b441b493d5c39c-top, hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ef509b56e0d66784b01bc975d7880c8d/cf/8b8a7256aca14dabb2f14eed619be8d2.d2ca0c75da6ff8bac9cf91aac6774018->hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d2ca0c75da6ff8bac9cf91aac6774018/cf/8b8a7256aca14dabb2f14eed619be8d2-top] hfiles 2023-07-15 21:12:14,896 DEBUG [rs(jenkins-hbase4.apache.org,39075,1689455452043)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/2): hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ef509b56e0d66784b01bc975d7880c8d/cf/703b611edc7643f783b441b493d5c39c.5612defd6493d7ed537979c51f83d054 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 21:12:14,897 DEBUG [rs(jenkins-hbase4.apache.org,39075,1689455452043)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (2/2): hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ef509b56e0d66784b01bc975d7880c8d/cf/8b8a7256aca14dabb2f14eed619be8d2.d2ca0c75da6ff8bac9cf91aac6774018 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 21:12:14,926 DEBUG [rs(jenkins-hbase4.apache.org,39075,1689455452043)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion-1,,1689455532844.ef509b56e0d66784b01bc975d7880c8d. completed. 2023-07-15 21:12:14,926 DEBUG [rs(jenkins-hbase4.apache.org,39075,1689455452043)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion-1,,1689455532844.ef509b56e0d66784b01bc975d7880c8d. 2023-07-15 21:12:14,926 DEBUG [member: 'jenkins-hbase4.apache.org,39075,1689455452043' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-15 21:12:14,927 DEBUG [member: 'jenkins-hbase4.apache.org,39075,1689455452043' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-15 21:12:14,927 DEBUG [member: 'jenkins-hbase4.apache.org,39075,1689455452043' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,39075,1689455452043 2023-07-15 21:12:14,927 DEBUG [member: 'jenkins-hbase4.apache.org,39075,1689455452043' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-07-15 21:12:14,927 DEBUG [member: 'jenkins-hbase4.apache.org,39075,1689455452043' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase4.apache.org,39075,1689455452043' in zk 2023-07-15 21:12:14,932 DEBUG [member: 'jenkins-hbase4.apache.org,39075,1689455452043' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-07-15 21:12:14,932 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): master:36465-0x1016ad2d8bb0000, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,39075,1689455452043 2023-07-15 21:12:14,932 DEBUG [member: 'jenkins-hbase4.apache.org,39075,1689455452043' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 21:12:14,932 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,39075,1689455452043 2023-07-15 21:12:14,932 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 21:12:14,932 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 21:12:14,932 DEBUG [member: 'jenkins-hbase4.apache.org,39075,1689455452043' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-07-15 21:12:14,933 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 21:12:14,933 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 21:12:14,934 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 21:12:14,934 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39075,1689455452043 2023-07-15 21:12:14,934 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39587,1689455451998 2023-07-15 21:12:14,935 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37853,1689455451932 2023-07-15 21:12:14,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 21:12:14,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 21:12:14,943 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39075,1689455452043 2023-07-15 21:12:14,943 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39587,1689455451998 2023-07-15 21:12:14,943 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37853,1689455451932 2023-07-15 21:12:14,944 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' member 'jenkins-hbase4.apache.org,39075,1689455452043': 2023-07-15 21:12:14,944 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39075,1689455452043' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion-1', counting down latch. Waiting for 0 more 2023-07-15 21:12:14,944 INFO [(jenkins-hbase4.apache.org,36465,1689455450507)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' execution completed 2023-07-15 21:12:14,944 DEBUG [(jenkins-hbase4.apache.org,36465,1689455450507)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-15 21:12:14,944 DEBUG [(jenkins-hbase4.apache.org,36465,1689455450507)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-15 21:12:14,944 DEBUG [(jenkins-hbase4.apache.org,36465,1689455450507)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 21:12:14,945 INFO [(jenkins-hbase4.apache.org,36465,1689455450507)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithMergeRegion-1including nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-15 21:12:14,947 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): regionserver:39075-0x1016ad2d8bb0003, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 21:12:14,947 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): regionserver:37853-0x1016ad2d8bb0001, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 21:12:14,947 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 21:12:14,947 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): regionserver:39075-0x1016ad2d8bb0003, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 21:12:14,947 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): master:36465-0x1016ad2d8bb0000, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 21:12:14,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 21:12:14,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 21:12:14,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 21:12:14,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 21:12:14,947 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 21:12:14,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 21:12:14,947 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): regionserver:37853-0x1016ad2d8bb0001, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 21:12:14,947 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): regionserver:39587-0x1016ad2d8bb0002, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 21:12:14,947 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): regionserver:39587-0x1016ad2d8bb0002, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 21:12:14,947 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 21:12:14,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 21:12:14,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 21:12:14,948 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 21:12:14,948 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 21:12:14,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 21:12:14,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 21:12:14,948 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 21:12:14,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 21:12:14,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 21:12:14,949 DEBUG [(jenkins-hbase4.apache.org,36465,1689455450507)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36465-0x1016ad2d8bb0000, quorum=127.0.0.1:50024, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,39075,1689455452043 2023-07-15 21:12:14,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 21:12:14,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 21:12:14,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 21:12:14,949 DEBUG [(jenkins-hbase4.apache.org,36465,1689455450507)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36465-0x1016ad2d8bb0000, quorum=127.0.0.1:50024, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,39587,1689455451998 2023-07-15 21:12:14,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 21:12:14,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 21:12:14,950 DEBUG [(jenkins-hbase4.apache.org,36465,1689455450507)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36465-0x1016ad2d8bb0000, quorum=127.0.0.1:50024, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,37853,1689455451932 2023-07-15 21:12:14,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39075,1689455452043 2023-07-15 21:12:14,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39587,1689455451998 2023-07-15 21:12:14,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37853,1689455451932 2023-07-15 21:12:14,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 21:12:14,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 21:12:14,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39075,1689455452043 2023-07-15 21:12:14,953 DEBUG [(jenkins-hbase4.apache.org,36465,1689455450507)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36465-0x1016ad2d8bb0000, quorum=127.0.0.1:50024, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,39075,1689455452043 2023-07-15 21:12:14,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39587,1689455451998 2023-07-15 21:12:14,954 DEBUG [(jenkins-hbase4.apache.org,36465,1689455450507)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36465-0x1016ad2d8bb0000, quorum=127.0.0.1:50024, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,39587,1689455451998 2023-07-15 21:12:14,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37853,1689455451932 2023-07-15 21:12:14,954 DEBUG [(jenkins-hbase4.apache.org,36465,1689455450507)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36465-0x1016ad2d8bb0000, quorum=127.0.0.1:50024, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,37853,1689455451932 2023-07-15 21:12:14,958 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): regionserver:37853-0x1016ad2d8bb0001, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 21:12:14,958 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): regionserver:39075-0x1016ad2d8bb0003, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 21:12:14,958 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 21:12:14,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 21:12:14,958 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 21:12:14,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 21:12:14,958 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): regionserver:39587-0x1016ad2d8bb0002, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 21:12:14,958 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): regionserver:39587-0x1016ad2d8bb0002, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 21:12:14,958 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 21:12:14,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 21:12:14,958 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): regionserver:39075-0x1016ad2d8bb0003, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 21:12:14,958 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): regionserver:37853-0x1016ad2d8bb0001, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 21:12:14,959 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 21:12:14,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 21:12:14,959 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): master:36465-0x1016ad2d8bb0000, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,37853,1689455451932 2023-07-15 21:12:14,959 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): master:36465-0x1016ad2d8bb0000, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 21:12:14,959 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): master:36465-0x1016ad2d8bb0000, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,39587,1689455451998 2023-07-15 21:12:14,959 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): master:36465-0x1016ad2d8bb0000, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,39075,1689455452043 2023-07-15 21:12:14,959 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): master:36465-0x1016ad2d8bb0000, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 21:12:14,959 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): master:36465-0x1016ad2d8bb0000, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,37853,1689455451932 2023-07-15 21:12:14,959 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): master:36465-0x1016ad2d8bb0000, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 21:12:14,959 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): master:36465-0x1016ad2d8bb0000, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,39587,1689455451998 2023-07-15 21:12:14,959 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): master:36465-0x1016ad2d8bb0000, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,39075,1689455452043 2023-07-15 21:12:14,959 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): master:36465-0x1016ad2d8bb0000, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 21:12:14,959 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): master:36465-0x1016ad2d8bb0000, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 21:12:14,959 DEBUG [(jenkins-hbase4.apache.org,36465,1689455450507)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 21:12:14,959 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 21:12:14,959 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 21:12:14,959 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 21:12:14,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 21:12:14,960 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 21:12:14,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 21:12:14,960 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 21:12:15,019 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 to hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 21:12:15,048 DEBUG [Listener at jenkins-hbase4.apache.org/41711] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-15 21:12:15,049 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36465] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } is done 2023-07-15 21:12:15,049 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36465] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }' is still in progress! 2023-07-15 21:12:15,049 DEBUG [Listener at jenkins-hbase4.apache.org/41711] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-15 21:12:15,064 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 of table testtb-testExportFileSystemStateWithMergeRegion-1 completed 2023-07-15 21:12:15,064 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 21:12:15,067 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 21:12:15,067 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion-1 at 1689455534737Consolidate snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1689455534959 (+222 ms)Loading Region manifests for snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1689455534959Writing data manifest for snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1689455534968 (+9 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1689455535000 (+32 ms)Snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 of table testtb-testExportFileSystemStateWithMergeRegion-1 completed at 1689455535064 (+64 ms) 2023-07-15 21:12:15,071 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=79, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-07-15 21:12:15,072 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=79, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED in 330 msec 2023-07-15 21:12:15,349 DEBUG [Listener at jenkins-hbase4.apache.org/41711] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-15 21:12:15,351 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36465] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } is done 2023-07-15 21:12:15,351 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36465] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-15 21:12:15,351 INFO [Listener at jenkins-hbase4.apache.org/41711] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/export-test/export-1689455535351 2023-07-15 21:12:15,351 INFO [Listener at jenkins-hbase4.apache.org/41711] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:46859, tgtDir=hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/export-test/export-1689455535351, rawTgtDir=hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/export-test/export-1689455535351, srcFsUri=hdfs://localhost:46859, srcDir=hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313 2023-07-15 21:12:15,353 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689455459463_0004_000001 (auth:SIMPLE) 2023-07-15 21:12:15,398 DEBUG [Listener at jenkins-hbase4.apache.org/41711] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:46859, inputRoot=hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313 2023-07-15 21:12:15,399 DEBUG [Listener at jenkins-hbase4.apache.org/41711] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_2045626466_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/export-test/export-1689455535351, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/export-test/export-1689455535351/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 21:12:15,399 INFO [Listener at jenkins-hbase4.apache.org/41711] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:46859, inputRoot=hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313, snapshotDir=hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1. 2023-07-15 21:12:15,431 INFO [Listener at jenkins-hbase4.apache.org/41711] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 to hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/export-test/export-1689455535351/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 21:12:15,536 DEBUG [Listener at jenkins-hbase4.apache.org/41711] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-15 21:12:15,537 DEBUG [Listener at jenkins-hbase4.apache.org/41711] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-15 21:12:15,537 DEBUG [Listener at jenkins-hbase4.apache.org/41711] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-15 21:12:15,538 DEBUG [Listener at jenkins-hbase4.apache.org/41711] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-15 21:12:15,538 DEBUG [Listener at jenkins-hbase4.apache.org/41711] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-15 21:12:15,539 DEBUG [Listener at jenkins-hbase4.apache.org/41711] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-15 21:12:15,539 DEBUG [Listener at jenkins-hbase4.apache.org/41711] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-15 21:12:15,629 DEBUG [Listener at jenkins-hbase4.apache.org/41711] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/de3e87f0-08fc-c0d0-c969-4c410fd4e6fd/hadoop-7242776546008524487.jar 2023-07-15 21:12:15,630 DEBUG [Listener at jenkins-hbase4.apache.org/41711] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-15 21:12:15,630 DEBUG [Listener at jenkins-hbase4.apache.org/41711] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-15 21:12:15,631 DEBUG [Listener at jenkins-hbase4.apache.org/41711] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-15 21:12:15,631 DEBUG [Listener at jenkins-hbase4.apache.org/41711] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-15 21:12:15,632 DEBUG [Listener at jenkins-hbase4.apache.org/41711] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-15 21:12:15,633 DEBUG [Listener at jenkins-hbase4.apache.org/41711] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-15 21:12:15,633 DEBUG [Listener at jenkins-hbase4.apache.org/41711] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-15 21:12:15,634 DEBUG [Listener at jenkins-hbase4.apache.org/41711] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-15 21:12:15,634 DEBUG [Listener at jenkins-hbase4.apache.org/41711] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-15 21:12:15,635 DEBUG [Listener at jenkins-hbase4.apache.org/41711] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-15 21:12:15,635 DEBUG [Listener at jenkins-hbase4.apache.org/41711] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-15 21:12:15,636 DEBUG [Listener at jenkins-hbase4.apache.org/41711] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-15 21:12:15,637 DEBUG [Listener at jenkins-hbase4.apache.org/41711] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-15 21:12:15,637 DEBUG [Listener at jenkins-hbase4.apache.org/41711] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-15 21:12:15,638 DEBUG [Listener at jenkins-hbase4.apache.org/41711] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-15 21:12:15,638 DEBUG [Listener at jenkins-hbase4.apache.org/41711] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-15 21:12:15,639 DEBUG [Listener at jenkins-hbase4.apache.org/41711] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-15 21:12:15,639 DEBUG [Listener at jenkins-hbase4.apache.org/41711] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-15 21:12:15,640 DEBUG [Listener at jenkins-hbase4.apache.org/41711] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-15 21:12:15,640 DEBUG [Listener at jenkins-hbase4.apache.org/41711] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-15 21:12:15,641 DEBUG [Listener at jenkins-hbase4.apache.org/41711] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-15 21:12:15,641 DEBUG [Listener at jenkins-hbase4.apache.org/41711] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-15 21:12:15,642 DEBUG [Listener at jenkins-hbase4.apache.org/41711] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-15 21:12:16,761 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-15 21:12:17,298 WARN [Listener at jenkins-hbase4.apache.org/41711] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-15 21:12:17,301 INFO [Listener at jenkins-hbase4.apache.org/41711] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemStateWithMergeRegion-1' hfile list 2023-07-15 21:12:17,304 DEBUG [Listener at jenkins-hbase4.apache.org/41711] snapshot.ExportSnapshot(671): export split=0 size=9.5 K 2023-07-15 21:12:17,442 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-15 21:12:17,442 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-15 21:12:18,097 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689455459463_0005_000001 (auth:SIMPLE) 2023-07-15 21:12:24,041 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689455459463_0005_000001 (auth:SIMPLE) 2023-07-15 21:12:26,383 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689455459463_0005_000001 (auth:SIMPLE) 2023-07-15 21:12:30,059 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689455459463_0005_000001 (auth:SIMPLE) 2023-07-15 21:12:31,613 INFO [Listener at jenkins-hbase4.apache.org/41711] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-15 21:12:31,617 INFO [Listener at jenkins-hbase4.apache.org/41711] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-15 21:12:31,626 INFO [Listener at jenkins-hbase4.apache.org/41711] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 21:12:31,626 INFO [Listener at jenkins-hbase4.apache.org/41711] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-15 21:12:31,626 INFO [Listener at jenkins-hbase4.apache.org/41711] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-15 21:12:31,627 DEBUG [Listener at jenkins-hbase4.apache.org/41711] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1600112846_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 at hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 21:12:31,627 DEBUG [Listener at jenkins-hbase4.apache.org/41711] snapshot.TestExportSnapshot(367): hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/.snapshotinfo 2023-07-15 21:12:31,627 DEBUG [Listener at jenkins-hbase4.apache.org/41711] snapshot.TestExportSnapshot(367): hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/data.manifest 2023-07-15 21:12:31,628 DEBUG [Listener at jenkins-hbase4.apache.org/41711] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1600112846_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/export-test/export-1689455535351/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 at hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/export-test/export-1689455535351/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 21:12:31,628 DEBUG [Listener at jenkins-hbase4.apache.org/41711] snapshot.TestExportSnapshot(367): hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/export-test/export-1689455535351/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/.snapshotinfo 2023-07-15 21:12:31,628 DEBUG [Listener at jenkins-hbase4.apache.org/41711] snapshot.TestExportSnapshot(367): hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/export-test/export-1689455535351/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/data.manifest 2023-07-15 21:12:31,635 INFO [Listener at jenkins-hbase4.apache.org/41711] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-15 21:12:31,635 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36465] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-15 21:12:31,636 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36465] procedure2.ProcedureExecutor(1029): Stored pid=80, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-15 21:12:31,639 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36465] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-07-15 21:12:31,639 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689455551639"}]},"ts":"1689455551639"} 2023-07-15 21:12:31,640 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=DISABLING in hbase:meta 2023-07-15 21:12:31,642 INFO [PEWorker-5] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithMergeRegion-1 to state=DISABLING 2023-07-15 21:12:31,642 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=81, ppid=80, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=ef509b56e0d66784b01bc975d7880c8d, UNASSIGN}] 2023-07-15 21:12:31,644 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=81, ppid=80, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=ef509b56e0d66784b01bc975d7880c8d, UNASSIGN 2023-07-15 21:12:31,645 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=ef509b56e0d66784b01bc975d7880c8d, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,39075,1689455452043 2023-07-15 21:12:31,645 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689455532844.ef509b56e0d66784b01bc975d7880c8d.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1689455551645"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689455551645"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689455551645"}]},"ts":"1689455551645"} 2023-07-15 21:12:31,646 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=82, ppid=81, state=RUNNABLE; CloseRegionProcedure ef509b56e0d66784b01bc975d7880c8d, server=jenkins-hbase4.apache.org,39075,1689455452043}] 2023-07-15 21:12:31,740 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36465] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-07-15 21:12:31,797 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close ef509b56e0d66784b01bc975d7880c8d 2023-07-15 21:12:31,797 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing ef509b56e0d66784b01bc975d7880c8d, disabling compactions & flushes 2023-07-15 21:12:31,798 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1689455532844.ef509b56e0d66784b01bc975d7880c8d. 2023-07-15 21:12:31,798 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689455532844.ef509b56e0d66784b01bc975d7880c8d. 2023-07-15 21:12:31,798 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689455532844.ef509b56e0d66784b01bc975d7880c8d. after waiting 0 ms 2023-07-15 21:12:31,798 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1689455532844.ef509b56e0d66784b01bc975d7880c8d. 2023-07-15 21:12:31,811 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ef509b56e0d66784b01bc975d7880c8d/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=8 2023-07-15 21:12:31,812 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-15 21:12:31,813 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1689455532844.ef509b56e0d66784b01bc975d7880c8d. 2023-07-15 21:12:31,813 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for ef509b56e0d66784b01bc975d7880c8d: 2023-07-15 21:12:31,815 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed ef509b56e0d66784b01bc975d7880c8d 2023-07-15 21:12:31,815 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=ef509b56e0d66784b01bc975d7880c8d, regionState=CLOSED 2023-07-15 21:12:31,815 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689455532844.ef509b56e0d66784b01bc975d7880c8d.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1689455551815"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689455551815"}]},"ts":"1689455551815"} 2023-07-15 21:12:31,826 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=82, resume processing ppid=81 2023-07-15 21:12:31,826 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=82, ppid=81, state=SUCCESS; CloseRegionProcedure ef509b56e0d66784b01bc975d7880c8d, server=jenkins-hbase4.apache.org,39075,1689455452043 in 177 msec 2023-07-15 21:12:31,829 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=81, resume processing ppid=80 2023-07-15 21:12:31,829 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=81, ppid=80, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=ef509b56e0d66784b01bc975d7880c8d, UNASSIGN in 184 msec 2023-07-15 21:12:31,830 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689455551830"}]},"ts":"1689455551830"} 2023-07-15 21:12:31,832 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=DISABLED in hbase:meta 2023-07-15 21:12:31,835 INFO [PEWorker-3] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithMergeRegion-1 to state=DISABLED 2023-07-15 21:12:31,837 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=80, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 200 msec 2023-07-15 21:12:31,943 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36465] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-07-15 21:12:31,944 INFO [Listener at jenkins-hbase4.apache.org/41711] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 80 completed 2023-07-15 21:12:31,945 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36465] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-15 21:12:31,946 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36465] procedure2.ProcedureExecutor(1029): Stored pid=83, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-15 21:12:31,948 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=83, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-15 21:12:31,949 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36465] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-15 21:12:31,949 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=83, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-15 21:12:31,951 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=39075] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-15 21:12:31,955 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): regionserver:39075-0x1016ad2d8bb0003, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-15 21:12:31,955 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): regionserver:39587-0x1016ad2d8bb0002, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-15 21:12:31,955 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): regionserver:37853-0x1016ad2d8bb0001, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-15 21:12:31,955 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): master:36465-0x1016ad2d8bb0000, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-15 21:12:31,956 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-07-15 21:12:31,956 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-07-15 21:12:31,956 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-07-15 21:12:31,961 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-07-15 21:12:31,962 DEBUG [HFileArchiver-19] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ef509b56e0d66784b01bc975d7880c8d 2023-07-15 21:12:31,962 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/5612defd6493d7ed537979c51f83d054 2023-07-15 21:12:31,962 DEBUG [HFileArchiver-20] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d2ca0c75da6ff8bac9cf91aac6774018 2023-07-15 21:12:31,962 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): regionserver:39075-0x1016ad2d8bb0003, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-15 21:12:31,963 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): regionserver:39075-0x1016ad2d8bb0003, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 21:12:31,963 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): regionserver:37853-0x1016ad2d8bb0001, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-15 21:12:31,963 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): master:36465-0x1016ad2d8bb0000, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-15 21:12:31,963 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): regionserver:39587-0x1016ad2d8bb0002, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-15 21:12:31,963 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): master:36465-0x1016ad2d8bb0000, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 21:12:31,963 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): regionserver:37853-0x1016ad2d8bb0001, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 21:12:31,963 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): regionserver:39587-0x1016ad2d8bb0002, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 21:12:31,964 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-15 21:12:31,964 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-15 21:12:31,964 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-15 21:12:31,965 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-15 21:12:31,965 DEBUG [HFileArchiver-19] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ef509b56e0d66784b01bc975d7880c8d/cf, FileablePath, hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ef509b56e0d66784b01bc975d7880c8d/recovered.edits] 2023-07-15 21:12:31,965 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/5612defd6493d7ed537979c51f83d054/cf, FileablePath, hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/5612defd6493d7ed537979c51f83d054/recovered.edits] 2023-07-15 21:12:31,971 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/5612defd6493d7ed537979c51f83d054/cf/703b611edc7643f783b441b493d5c39c to hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/5612defd6493d7ed537979c51f83d054/cf/703b611edc7643f783b441b493d5c39c 2023-07-15 21:12:31,971 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36465] master.MasterRpcServices(1230): Checking to see if procedure is done pid=83 2023-07-15 21:12:31,972 DEBUG [HFileArchiver-20] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d2ca0c75da6ff8bac9cf91aac6774018/cf, FileablePath, hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d2ca0c75da6ff8bac9cf91aac6774018/recovered.edits] 2023-07-15 21:12:31,978 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/5612defd6493d7ed537979c51f83d054/recovered.edits/8.seqid to hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/5612defd6493d7ed537979c51f83d054/recovered.edits/8.seqid 2023-07-15 21:12:31,979 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/5612defd6493d7ed537979c51f83d054 2023-07-15 21:12:31,983 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ef509b56e0d66784b01bc975d7880c8d/cf/703b611edc7643f783b441b493d5c39c.5612defd6493d7ed537979c51f83d054 to hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ef509b56e0d66784b01bc975d7880c8d/cf/703b611edc7643f783b441b493d5c39c.5612defd6493d7ed537979c51f83d054 2023-07-15 21:12:31,986 DEBUG [HFileArchiver-20] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d2ca0c75da6ff8bac9cf91aac6774018/cf/8b8a7256aca14dabb2f14eed619be8d2 to hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d2ca0c75da6ff8bac9cf91aac6774018/cf/8b8a7256aca14dabb2f14eed619be8d2 2023-07-15 21:12:31,987 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ef509b56e0d66784b01bc975d7880c8d/cf/8b8a7256aca14dabb2f14eed619be8d2.d2ca0c75da6ff8bac9cf91aac6774018 to hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ef509b56e0d66784b01bc975d7880c8d/cf/8b8a7256aca14dabb2f14eed619be8d2.d2ca0c75da6ff8bac9cf91aac6774018 2023-07-15 21:12:31,996 DEBUG [HFileArchiver-20] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d2ca0c75da6ff8bac9cf91aac6774018/recovered.edits/8.seqid to hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d2ca0c75da6ff8bac9cf91aac6774018/recovered.edits/8.seqid 2023-07-15 21:12:31,997 DEBUG [HFileArchiver-20] backup.HFileArchiver(596): Deleted hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d2ca0c75da6ff8bac9cf91aac6774018 2023-07-15 21:12:31,997 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ef509b56e0d66784b01bc975d7880c8d/recovered.edits/12.seqid to hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ef509b56e0d66784b01bc975d7880c8d/recovered.edits/12.seqid 2023-07-15 21:12:31,998 DEBUG [HFileArchiver-19] backup.HFileArchiver(596): Deleted hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ef509b56e0d66784b01bc975d7880c8d 2023-07-15 21:12:31,998 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion-1 regions 2023-07-15 21:12:32,002 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=83, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-15 21:12:32,005 WARN [PEWorker-4] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of testtb-testExportFileSystemStateWithMergeRegion-1 from hbase:meta 2023-07-15 21:12:32,007 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithMergeRegion-1' descriptor. 2023-07-15 21:12:32,008 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=83, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-15 21:12:32,008 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithMergeRegion-1' from region states. 2023-07-15 21:12:32,009 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689455532844.ef509b56e0d66784b01bc975d7880c8d.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689455552008"}]},"ts":"9223372036854775807"} 2023-07-15 21:12:32,010 INFO [PEWorker-4] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2023-07-15 21:12:32,010 DEBUG [PEWorker-4] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => ef509b56e0d66784b01bc975d7880c8d, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1689455532844.ef509b56e0d66784b01bc975d7880c8d.', STARTKEY => '', ENDKEY => ''}] 2023-07-15 21:12:32,010 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithMergeRegion-1' as deleted. 2023-07-15 21:12:32,010 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689455552010"}]},"ts":"9223372036854775807"} 2023-07-15 21:12:32,016 INFO [PEWorker-4] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithMergeRegion-1 state from META 2023-07-15 21:12:32,020 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(130): Finished pid=83, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-15 21:12:32,022 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=83, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 75 msec 2023-07-15 21:12:32,073 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36465] master.MasterRpcServices(1230): Checking to see if procedure is done pid=83 2023-07-15 21:12:32,073 INFO [Listener at jenkins-hbase4.apache.org/41711] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 83 completed 2023-07-15 21:12:32,074 INFO [Listener at jenkins-hbase4.apache.org/41711] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithMergeRegion 2023-07-15 21:12:32,074 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36465] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemStateWithMergeRegion 2023-07-15 21:12:32,075 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36465] procedure2.ProcedureExecutor(1029): Stored pid=84, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-15 21:12:32,079 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36465] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-07-15 21:12:32,079 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689455552079"}]},"ts":"1689455552079"} 2023-07-15 21:12:32,080 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=DISABLING in hbase:meta 2023-07-15 21:12:32,083 INFO [PEWorker-2] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithMergeRegion to state=DISABLING 2023-07-15 21:12:32,084 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=85, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=38967c9fac58073db9cd7c3d8c65764f, UNASSIGN}, {pid=86, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=232d1bc0cd1672f160a30b34098a567c, UNASSIGN}] 2023-07-15 21:12:32,086 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=85, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=38967c9fac58073db9cd7c3d8c65764f, UNASSIGN 2023-07-15 21:12:32,086 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=86, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=232d1bc0cd1672f160a30b34098a567c, UNASSIGN 2023-07-15 21:12:32,087 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=85 updating hbase:meta row=38967c9fac58073db9cd7c3d8c65764f, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,39587,1689455451998 2023-07-15 21:12:32,087 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=86 updating hbase:meta row=232d1bc0cd1672f160a30b34098a567c, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,37853,1689455451932 2023-07-15 21:12:32,087 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689455531454.38967c9fac58073db9cd7c3d8c65764f.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689455552087"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689455552087"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689455552087"}]},"ts":"1689455552087"} 2023-07-15 21:12:32,087 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689455531454.232d1bc0cd1672f160a30b34098a567c.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689455552087"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689455552087"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689455552087"}]},"ts":"1689455552087"} 2023-07-15 21:12:32,089 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=87, ppid=85, state=RUNNABLE; CloseRegionProcedure 38967c9fac58073db9cd7c3d8c65764f, server=jenkins-hbase4.apache.org,39587,1689455451998}] 2023-07-15 21:12:32,090 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=88, ppid=86, state=RUNNABLE; CloseRegionProcedure 232d1bc0cd1672f160a30b34098a567c, server=jenkins-hbase4.apache.org,37853,1689455451932}] 2023-07-15 21:12:32,180 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36465] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-07-15 21:12:32,243 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 232d1bc0cd1672f160a30b34098a567c 2023-07-15 21:12:32,243 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 38967c9fac58073db9cd7c3d8c65764f 2023-07-15 21:12:32,243 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 232d1bc0cd1672f160a30b34098a567c, disabling compactions & flushes 2023-07-15 21:12:32,243 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 38967c9fac58073db9cd7c3d8c65764f, disabling compactions & flushes 2023-07-15 21:12:32,243 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,1,1689455531454.232d1bc0cd1672f160a30b34098a567c. 2023-07-15 21:12:32,243 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,,1689455531454.38967c9fac58073db9cd7c3d8c65764f. 2023-07-15 21:12:32,243 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1689455531454.232d1bc0cd1672f160a30b34098a567c. 2023-07-15 21:12:32,243 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,,1689455531454.38967c9fac58073db9cd7c3d8c65764f. 2023-07-15 21:12:32,243 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,,1689455531454.38967c9fac58073db9cd7c3d8c65764f. after waiting 0 ms 2023-07-15 21:12:32,243 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1689455531454.232d1bc0cd1672f160a30b34098a567c. after waiting 0 ms 2023-07-15 21:12:32,243 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,,1689455531454.38967c9fac58073db9cd7c3d8c65764f. 2023-07-15 21:12:32,243 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,1,1689455531454.232d1bc0cd1672f160a30b34098a567c. 2023-07-15 21:12:32,259 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/data/default/testtb-testExportFileSystemStateWithMergeRegion/38967c9fac58073db9cd7c3d8c65764f/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-15 21:12:32,260 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/data/default/testtb-testExportFileSystemStateWithMergeRegion/232d1bc0cd1672f160a30b34098a567c/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-15 21:12:32,260 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-15 21:12:32,261 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,,1689455531454.38967c9fac58073db9cd7c3d8c65764f. 2023-07-15 21:12:32,261 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 38967c9fac58073db9cd7c3d8c65764f: 2023-07-15 21:12:32,261 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-15 21:12:32,262 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,1,1689455531454.232d1bc0cd1672f160a30b34098a567c. 2023-07-15 21:12:32,262 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 232d1bc0cd1672f160a30b34098a567c: 2023-07-15 21:12:32,263 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 38967c9fac58073db9cd7c3d8c65764f 2023-07-15 21:12:32,264 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=85 updating hbase:meta row=38967c9fac58073db9cd7c3d8c65764f, regionState=CLOSED 2023-07-15 21:12:32,264 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689455531454.38967c9fac58073db9cd7c3d8c65764f.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689455552264"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689455552264"}]},"ts":"1689455552264"} 2023-07-15 21:12:32,264 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 232d1bc0cd1672f160a30b34098a567c 2023-07-15 21:12:32,265 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=86 updating hbase:meta row=232d1bc0cd1672f160a30b34098a567c, regionState=CLOSED 2023-07-15 21:12:32,265 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689455531454.232d1bc0cd1672f160a30b34098a567c.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689455552265"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689455552265"}]},"ts":"1689455552265"} 2023-07-15 21:12:32,267 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=87, resume processing ppid=85 2023-07-15 21:12:32,267 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=87, ppid=85, state=SUCCESS; CloseRegionProcedure 38967c9fac58073db9cd7c3d8c65764f, server=jenkins-hbase4.apache.org,39587,1689455451998 in 176 msec 2023-07-15 21:12:32,268 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=88, resume processing ppid=86 2023-07-15 21:12:32,268 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=88, ppid=86, state=SUCCESS; CloseRegionProcedure 232d1bc0cd1672f160a30b34098a567c, server=jenkins-hbase4.apache.org,37853,1689455451932 in 176 msec 2023-07-15 21:12:32,268 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=85, ppid=84, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=38967c9fac58073db9cd7c3d8c65764f, UNASSIGN in 184 msec 2023-07-15 21:12:32,270 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=86, resume processing ppid=84 2023-07-15 21:12:32,270 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=86, ppid=84, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=232d1bc0cd1672f160a30b34098a567c, UNASSIGN in 185 msec 2023-07-15 21:12:32,271 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689455552271"}]},"ts":"1689455552271"} 2023-07-15 21:12:32,272 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=DISABLED in hbase:meta 2023-07-15 21:12:32,274 INFO [PEWorker-4] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithMergeRegion to state=DISABLED 2023-07-15 21:12:32,277 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=84, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 200 msec 2023-07-15 21:12:32,381 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36465] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-07-15 21:12:32,381 INFO [Listener at jenkins-hbase4.apache.org/41711] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 84 completed 2023-07-15 21:12:32,383 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36465] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemStateWithMergeRegion 2023-07-15 21:12:32,384 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36465] procedure2.ProcedureExecutor(1029): Stored pid=89, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-15 21:12:32,386 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=89, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-15 21:12:32,387 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36465] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithMergeRegion 2023-07-15 21:12:32,387 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=89, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-15 21:12:32,389 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=39075] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithMergeRegion 2023-07-15 21:12:32,392 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): regionserver:39075-0x1016ad2d8bb0003, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-15 21:12:32,392 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): regionserver:37853-0x1016ad2d8bb0001, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-15 21:12:32,392 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): regionserver:39587-0x1016ad2d8bb0002, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-15 21:12:32,393 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/38967c9fac58073db9cd7c3d8c65764f 2023-07-15 21:12:32,393 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/232d1bc0cd1672f160a30b34098a567c 2023-07-15 21:12:32,393 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-07-15 21:12:32,393 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-07-15 21:12:32,393 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-07-15 21:12:32,394 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): master:36465-0x1016ad2d8bb0000, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-15 21:12:32,397 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): regionserver:37853-0x1016ad2d8bb0001, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-15 21:12:32,397 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): regionserver:39075-0x1016ad2d8bb0003, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-15 21:12:32,397 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): regionserver:39075-0x1016ad2d8bb0003, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 21:12:32,397 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): regionserver:39587-0x1016ad2d8bb0002, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-15 21:12:32,397 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): regionserver:39587-0x1016ad2d8bb0002, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 21:12:32,397 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data null 2023-07-15 21:12:32,398 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-15 21:12:32,397 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): master:36465-0x1016ad2d8bb0000, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 21:12:32,397 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): regionserver:37853-0x1016ad2d8bb0001, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 21:12:32,398 DEBUG [HFileArchiver-15] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/232d1bc0cd1672f160a30b34098a567c/cf, FileablePath, hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/232d1bc0cd1672f160a30b34098a567c/recovered.edits] 2023-07-15 21:12:32,398 DEBUG [HFileArchiver-14] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/38967c9fac58073db9cd7c3d8c65764f/cf, FileablePath, hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/38967c9fac58073db9cd7c3d8c65764f/recovered.edits] 2023-07-15 21:12:32,399 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36465] master.MasterRpcServices(1230): Checking to see if procedure is done pid=89 2023-07-15 21:12:32,402 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/38967c9fac58073db9cd7c3d8c65764f/cf/562dc122e35645ae8dd1a5ca19bf18e6 to hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/38967c9fac58073db9cd7c3d8c65764f/cf/562dc122e35645ae8dd1a5ca19bf18e6 2023-07-15 21:12:32,402 DEBUG [HFileArchiver-15] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/232d1bc0cd1672f160a30b34098a567c/cf/20604d0d408944858330cd14680154e8 to hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/232d1bc0cd1672f160a30b34098a567c/cf/20604d0d408944858330cd14680154e8 2023-07-15 21:12:32,406 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/38967c9fac58073db9cd7c3d8c65764f/recovered.edits/9.seqid to hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/38967c9fac58073db9cd7c3d8c65764f/recovered.edits/9.seqid 2023-07-15 21:12:32,406 DEBUG [HFileArchiver-15] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/232d1bc0cd1672f160a30b34098a567c/recovered.edits/9.seqid to hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/232d1bc0cd1672f160a30b34098a567c/recovered.edits/9.seqid 2023-07-15 21:12:32,407 DEBUG [HFileArchiver-14] backup.HFileArchiver(596): Deleted hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/38967c9fac58073db9cd7c3d8c65764f 2023-07-15 21:12:32,407 DEBUG [HFileArchiver-15] backup.HFileArchiver(596): Deleted hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/232d1bc0cd1672f160a30b34098a567c 2023-07-15 21:12:32,407 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion regions 2023-07-15 21:12:32,407 DEBUG [PEWorker-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c 2023-07-15 21:12:32,408 DEBUG [PEWorker-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf] 2023-07-15 21:12:32,412 DEBUG [PEWorker-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b2023071568b1093a674c45868f7ddc13b198deb5 to hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b2023071568b1093a674c45868f7ddc13b198deb5 2023-07-15 21:12:32,413 DEBUG [PEWorker-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e202307151455e4b008c7430bbc85cd80ca3fabf4 to hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e202307151455e4b008c7430bbc85cd80ca3fabf4 2023-07-15 21:12:32,414 DEBUG [PEWorker-5] backup.HFileArchiver(596): Deleted hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c 2023-07-15 21:12:32,416 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=89, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-15 21:12:32,419 WARN [PEWorker-5] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemStateWithMergeRegion from hbase:meta 2023-07-15 21:12:32,421 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithMergeRegion' descriptor. 2023-07-15 21:12:32,426 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=89, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-15 21:12:32,426 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithMergeRegion' from region states. 2023-07-15 21:12:32,426 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689455531454.38967c9fac58073db9cd7c3d8c65764f.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689455552426"}]},"ts":"9223372036854775807"} 2023-07-15 21:12:32,426 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689455531454.232d1bc0cd1672f160a30b34098a567c.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689455552426"}]},"ts":"9223372036854775807"} 2023-07-15 21:12:32,427 INFO [PEWorker-5] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-15 21:12:32,427 DEBUG [PEWorker-5] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 38967c9fac58073db9cd7c3d8c65764f, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1689455531454.38967c9fac58073db9cd7c3d8c65764f.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 232d1bc0cd1672f160a30b34098a567c, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1689455531454.232d1bc0cd1672f160a30b34098a567c.', STARTKEY => '1', ENDKEY => ''}] 2023-07-15 21:12:32,428 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithMergeRegion' as deleted. 2023-07-15 21:12:32,428 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689455552428"}]},"ts":"9223372036854775807"} 2023-07-15 21:12:32,429 INFO [PEWorker-5] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithMergeRegion state from META 2023-07-15 21:12:32,431 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(130): Finished pid=89, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-15 21:12:32,432 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=89, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 48 msec 2023-07-15 21:12:32,500 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36465] master.MasterRpcServices(1230): Checking to see if procedure is done pid=89 2023-07-15 21:12:32,501 INFO [Listener at jenkins-hbase4.apache.org/41711] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 89 completed 2023-07-15 21:12:32,515 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36465] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportFileSystemStateWithMergeRegion" 2023-07-15 21:12:32,517 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36465] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 21:12:32,522 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36465] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemStateWithMergeRegion" 2023-07-15 21:12:32,528 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36465] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 21:12:32,530 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36465] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemStateWithMergeRegion-1" 2023-07-15 21:12:32,533 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36465] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 21:12:32,566 INFO [Listener at jenkins-hbase4.apache.org/41711] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithMergeRegion Thread=758 (was 746) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1340799591_1 at /127.0.0.1:43224 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-4225 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: HFileArchiver-17 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1600112846_17 at /127.0.0.1:47694 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LogDeleter #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1088) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x401a2f8d-shared-pool-30 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LogDeleter #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1088) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-7 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (2038956992) connection to jenkins-hbase4.apache.org/172.31.14.131:33161 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: hconnection-0x401a2f8d-shared-pool-33 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-16 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-15 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1600112846_17 at /127.0.0.1:45040 [Waiting for operation #6] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #7 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x401a2f8d-shared-pool-31 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x401a2f8d-shared-pool-28 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x401a2f8d-shared-pool-29 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-6 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #8 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-5 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-18 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x401a2f8d-shared-pool-32 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-19 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1600112846_17 at /127.0.0.1:35712 [Waiting for operation #6] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-20 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=903 (was 906), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=486 (was 341) - SystemLoadAverage LEAK? -, ProcessCount=182 (was 178) - ProcessCount LEAK? -, AvailableMemoryMB=2178 (was 3637) 2023-07-15 21:12:32,567 WARN [Listener at jenkins-hbase4.apache.org/41711] hbase.ResourceChecker(130): Thread=758 is superior to 500 2023-07-15 21:12:32,594 INFO [Listener at jenkins-hbase4.apache.org/41711] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testEmptyExportFileSystemState Thread=758, OpenFileDescriptor=903, MaxFileDescriptor=60000, SystemLoadAverage=486, ProcessCount=182, AvailableMemoryMB=2175 2023-07-15 21:12:32,594 WARN [Listener at jenkins-hbase4.apache.org/41711] hbase.ResourceChecker(130): Thread=758 is superior to 500 2023-07-15 21:12:32,596 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36465] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-07-15 21:12:32,597 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36465] procedure2.ProcedureExecutor(1029): Stored pid=90, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-15 21:12:32,603 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_PRE_OPERATION 2023-07-15 21:12:32,603 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36465] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testEmptyExportFileSystemState" procId is: 90 2023-07-15 21:12:32,604 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-15 21:12:32,605 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36465] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-15 21:12:32,607 DEBUG [HFileArchiver-16] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/.tmp/data/default/testtb-testEmptyExportFileSystemState/c2ab947ec4d68b6742a54dbdc97c072d 2023-07-15 21:12:32,607 DEBUG [HFileArchiver-17] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/.tmp/data/default/testtb-testEmptyExportFileSystemState/6ca340acf4d63312d822bf8e2b9da104 2023-07-15 21:12:32,610 DEBUG [HFileArchiver-17] backup.HFileArchiver(153): Directory hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/.tmp/data/default/testtb-testEmptyExportFileSystemState/6ca340acf4d63312d822bf8e2b9da104 empty. 2023-07-15 21:12:32,610 DEBUG [HFileArchiver-17] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/.tmp/data/default/testtb-testEmptyExportFileSystemState/6ca340acf4d63312d822bf8e2b9da104 2023-07-15 21:12:32,610 DEBUG [HFileArchiver-16] backup.HFileArchiver(153): Directory hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/.tmp/data/default/testtb-testEmptyExportFileSystemState/c2ab947ec4d68b6742a54dbdc97c072d empty. 2023-07-15 21:12:32,611 DEBUG [HFileArchiver-16] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/.tmp/data/default/testtb-testEmptyExportFileSystemState/c2ab947ec4d68b6742a54dbdc97c072d 2023-07-15 21:12:32,611 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testEmptyExportFileSystemState regions 2023-07-15 21:12:32,636 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/.tmp/data/default/testtb-testEmptyExportFileSystemState/.tabledesc/.tableinfo.0000000001 2023-07-15 21:12:32,637 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(7675): creating {ENCODED => c2ab947ec4d68b6742a54dbdc97c072d, NAME => 'testtb-testEmptyExportFileSystemState,,1689455552596.c2ab947ec4d68b6742a54dbdc97c072d.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/.tmp 2023-07-15 21:12:32,638 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(7675): creating {ENCODED => 6ca340acf4d63312d822bf8e2b9da104, NAME => 'testtb-testEmptyExportFileSystemState,1,1689455552596.6ca340acf4d63312d822bf8e2b9da104.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/.tmp 2023-07-15 21:12:32,691 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,1,1689455552596.6ca340acf4d63312d822bf8e2b9da104.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-15 21:12:32,691 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1604): Closing 6ca340acf4d63312d822bf8e2b9da104, disabling compactions & flushes 2023-07-15 21:12:32,691 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,1,1689455552596.6ca340acf4d63312d822bf8e2b9da104. 2023-07-15 21:12:32,691 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,1,1689455552596.6ca340acf4d63312d822bf8e2b9da104. 2023-07-15 21:12:32,691 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,1,1689455552596.6ca340acf4d63312d822bf8e2b9da104. after waiting 0 ms 2023-07-15 21:12:32,691 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,1,1689455552596.6ca340acf4d63312d822bf8e2b9da104. 2023-07-15 21:12:32,691 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,1,1689455552596.6ca340acf4d63312d822bf8e2b9da104. 2023-07-15 21:12:32,691 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1558): Region close journal for 6ca340acf4d63312d822bf8e2b9da104: 2023-07-15 21:12:32,694 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,,1689455552596.c2ab947ec4d68b6742a54dbdc97c072d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-15 21:12:32,694 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1604): Closing c2ab947ec4d68b6742a54dbdc97c072d, disabling compactions & flushes 2023-07-15 21:12:32,694 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,,1689455552596.c2ab947ec4d68b6742a54dbdc97c072d. 2023-07-15 21:12:32,694 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,,1689455552596.c2ab947ec4d68b6742a54dbdc97c072d. 2023-07-15 21:12:32,694 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,,1689455552596.c2ab947ec4d68b6742a54dbdc97c072d. after waiting 0 ms 2023-07-15 21:12:32,694 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,,1689455552596.c2ab947ec4d68b6742a54dbdc97c072d. 2023-07-15 21:12:32,694 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,,1689455552596.c2ab947ec4d68b6742a54dbdc97c072d. 2023-07-15 21:12:32,694 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1558): Region close journal for c2ab947ec4d68b6742a54dbdc97c072d: 2023-07-15 21:12:32,697 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_ADD_TO_META 2023-07-15 21:12:32,698 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,1,1689455552596.6ca340acf4d63312d822bf8e2b9da104.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689455552698"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689455552698"}]},"ts":"1689455552698"} 2023-07-15 21:12:32,698 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,,1689455552596.c2ab947ec4d68b6742a54dbdc97c072d.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689455552698"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689455552698"}]},"ts":"1689455552698"} 2023-07-15 21:12:32,702 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-15 21:12:32,703 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-15 21:12:32,703 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689455552703"}]},"ts":"1689455552703"} 2023-07-15 21:12:32,705 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=ENABLING in hbase:meta 2023-07-15 21:12:32,707 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36465] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-15 21:12:32,709 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-15 21:12:32,711 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-15 21:12:32,711 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-15 21:12:32,711 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-15 21:12:32,711 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-15 21:12:32,711 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=c2ab947ec4d68b6742a54dbdc97c072d, ASSIGN}, {pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=6ca340acf4d63312d822bf8e2b9da104, ASSIGN}] 2023-07-15 21:12:32,717 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=c2ab947ec4d68b6742a54dbdc97c072d, ASSIGN 2023-07-15 21:12:32,717 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=6ca340acf4d63312d822bf8e2b9da104, ASSIGN 2023-07-15 21:12:32,719 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=c2ab947ec4d68b6742a54dbdc97c072d, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,39587,1689455451998; forceNewPlan=false, retain=false 2023-07-15 21:12:32,719 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=6ca340acf4d63312d822bf8e2b9da104, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,39075,1689455452043; forceNewPlan=false, retain=false 2023-07-15 21:12:32,869 INFO [jenkins-hbase4:36465] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-15 21:12:32,873 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=92 updating hbase:meta row=6ca340acf4d63312d822bf8e2b9da104, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,39075,1689455452043 2023-07-15 21:12:32,873 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=c2ab947ec4d68b6742a54dbdc97c072d, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,39587,1689455451998 2023-07-15 21:12:32,873 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,1,1689455552596.6ca340acf4d63312d822bf8e2b9da104.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689455552873"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689455552873"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689455552873"}]},"ts":"1689455552873"} 2023-07-15 21:12:32,873 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,,1689455552596.c2ab947ec4d68b6742a54dbdc97c072d.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689455552873"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689455552873"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689455552873"}]},"ts":"1689455552873"} 2023-07-15 21:12:32,876 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=93, ppid=92, state=RUNNABLE; OpenRegionProcedure 6ca340acf4d63312d822bf8e2b9da104, server=jenkins-hbase4.apache.org,39075,1689455452043}] 2023-07-15 21:12:32,879 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=94, ppid=91, state=RUNNABLE; OpenRegionProcedure c2ab947ec4d68b6742a54dbdc97c072d, server=jenkins-hbase4.apache.org,39587,1689455451998}] 2023-07-15 21:12:32,908 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36465] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-15 21:12:33,030 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testEmptyExportFileSystemState,1,1689455552596.6ca340acf4d63312d822bf8e2b9da104. 2023-07-15 21:12:33,030 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 6ca340acf4d63312d822bf8e2b9da104, NAME => 'testtb-testEmptyExportFileSystemState,1,1689455552596.6ca340acf4d63312d822bf8e2b9da104.', STARTKEY => '1', ENDKEY => ''} 2023-07-15 21:12:33,030 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testEmptyExportFileSystemState,1,1689455552596.6ca340acf4d63312d822bf8e2b9da104. service=AccessControlService 2023-07-15 21:12:33,030 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-15 21:12:33,031 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testEmptyExportFileSystemState 6ca340acf4d63312d822bf8e2b9da104 2023-07-15 21:12:33,031 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,1,1689455552596.6ca340acf4d63312d822bf8e2b9da104.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-15 21:12:33,031 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 6ca340acf4d63312d822bf8e2b9da104 2023-07-15 21:12:33,031 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 6ca340acf4d63312d822bf8e2b9da104 2023-07-15 21:12:33,032 INFO [StoreOpener-6ca340acf4d63312d822bf8e2b9da104-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 6ca340acf4d63312d822bf8e2b9da104 2023-07-15 21:12:33,033 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testEmptyExportFileSystemState,,1689455552596.c2ab947ec4d68b6742a54dbdc97c072d. 2023-07-15 21:12:33,033 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => c2ab947ec4d68b6742a54dbdc97c072d, NAME => 'testtb-testEmptyExportFileSystemState,,1689455552596.c2ab947ec4d68b6742a54dbdc97c072d.', STARTKEY => '', ENDKEY => '1'} 2023-07-15 21:12:33,033 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testEmptyExportFileSystemState,,1689455552596.c2ab947ec4d68b6742a54dbdc97c072d. service=AccessControlService 2023-07-15 21:12:33,033 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-15 21:12:33,034 DEBUG [StoreOpener-6ca340acf4d63312d822bf8e2b9da104-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/data/default/testtb-testEmptyExportFileSystemState/6ca340acf4d63312d822bf8e2b9da104/cf 2023-07-15 21:12:33,034 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testEmptyExportFileSystemState c2ab947ec4d68b6742a54dbdc97c072d 2023-07-15 21:12:33,034 DEBUG [StoreOpener-6ca340acf4d63312d822bf8e2b9da104-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/data/default/testtb-testEmptyExportFileSystemState/6ca340acf4d63312d822bf8e2b9da104/cf 2023-07-15 21:12:33,034 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,,1689455552596.c2ab947ec4d68b6742a54dbdc97c072d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-15 21:12:33,034 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for c2ab947ec4d68b6742a54dbdc97c072d 2023-07-15 21:12:33,034 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for c2ab947ec4d68b6742a54dbdc97c072d 2023-07-15 21:12:33,034 INFO [StoreOpener-6ca340acf4d63312d822bf8e2b9da104-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 6ca340acf4d63312d822bf8e2b9da104 columnFamilyName cf 2023-07-15 21:12:33,036 INFO [StoreOpener-6ca340acf4d63312d822bf8e2b9da104-1] regionserver.HStore(310): Store=6ca340acf4d63312d822bf8e2b9da104/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-15 21:12:33,039 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/data/default/testtb-testEmptyExportFileSystemState/6ca340acf4d63312d822bf8e2b9da104 2023-07-15 21:12:33,039 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/data/default/testtb-testEmptyExportFileSystemState/6ca340acf4d63312d822bf8e2b9da104 2023-07-15 21:12:33,041 INFO [StoreOpener-c2ab947ec4d68b6742a54dbdc97c072d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region c2ab947ec4d68b6742a54dbdc97c072d 2023-07-15 21:12:33,042 DEBUG [StoreOpener-c2ab947ec4d68b6742a54dbdc97c072d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/data/default/testtb-testEmptyExportFileSystemState/c2ab947ec4d68b6742a54dbdc97c072d/cf 2023-07-15 21:12:33,042 DEBUG [StoreOpener-c2ab947ec4d68b6742a54dbdc97c072d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/data/default/testtb-testEmptyExportFileSystemState/c2ab947ec4d68b6742a54dbdc97c072d/cf 2023-07-15 21:12:33,043 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 6ca340acf4d63312d822bf8e2b9da104 2023-07-15 21:12:33,043 INFO [StoreOpener-c2ab947ec4d68b6742a54dbdc97c072d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c2ab947ec4d68b6742a54dbdc97c072d columnFamilyName cf 2023-07-15 21:12:33,044 INFO [StoreOpener-c2ab947ec4d68b6742a54dbdc97c072d-1] regionserver.HStore(310): Store=c2ab947ec4d68b6742a54dbdc97c072d/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-15 21:12:33,045 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/data/default/testtb-testEmptyExportFileSystemState/c2ab947ec4d68b6742a54dbdc97c072d 2023-07-15 21:12:33,045 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/data/default/testtb-testEmptyExportFileSystemState/c2ab947ec4d68b6742a54dbdc97c072d 2023-07-15 21:12:33,045 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/data/default/testtb-testEmptyExportFileSystemState/6ca340acf4d63312d822bf8e2b9da104/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-15 21:12:33,046 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 6ca340acf4d63312d822bf8e2b9da104; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74540797, jitterRate=0.1107444316148758}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-15 21:12:33,046 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 6ca340acf4d63312d822bf8e2b9da104: 2023-07-15 21:12:33,049 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for c2ab947ec4d68b6742a54dbdc97c072d 2023-07-15 21:12:33,050 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testEmptyExportFileSystemState,1,1689455552596.6ca340acf4d63312d822bf8e2b9da104., pid=93, masterSystemTime=1689455553027 2023-07-15 21:12:33,051 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/data/default/testtb-testEmptyExportFileSystemState/c2ab947ec4d68b6742a54dbdc97c072d/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-15 21:12:33,051 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened c2ab947ec4d68b6742a54dbdc97c072d; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62072692, jitterRate=-0.07504481077194214}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-15 21:12:33,051 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for c2ab947ec4d68b6742a54dbdc97c072d: 2023-07-15 21:12:33,052 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testEmptyExportFileSystemState,1,1689455552596.6ca340acf4d63312d822bf8e2b9da104. 2023-07-15 21:12:33,052 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testEmptyExportFileSystemState,1,1689455552596.6ca340acf4d63312d822bf8e2b9da104. 2023-07-15 21:12:33,052 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testEmptyExportFileSystemState,,1689455552596.c2ab947ec4d68b6742a54dbdc97c072d., pid=94, masterSystemTime=1689455553030 2023-07-15 21:12:33,052 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=92 updating hbase:meta row=6ca340acf4d63312d822bf8e2b9da104, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,39075,1689455452043 2023-07-15 21:12:33,053 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testEmptyExportFileSystemState,1,1689455552596.6ca340acf4d63312d822bf8e2b9da104.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689455553052"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689455553052"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689455553052"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689455553052"}]},"ts":"1689455553052"} 2023-07-15 21:12:33,054 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testEmptyExportFileSystemState,,1689455552596.c2ab947ec4d68b6742a54dbdc97c072d. 2023-07-15 21:12:33,054 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testEmptyExportFileSystemState,,1689455552596.c2ab947ec4d68b6742a54dbdc97c072d. 2023-07-15 21:12:33,054 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=c2ab947ec4d68b6742a54dbdc97c072d, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,39587,1689455451998 2023-07-15 21:12:33,054 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testEmptyExportFileSystemState,,1689455552596.c2ab947ec4d68b6742a54dbdc97c072d.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689455553054"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689455553054"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689455553054"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689455553054"}]},"ts":"1689455553054"} 2023-07-15 21:12:33,057 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=93, resume processing ppid=92 2023-07-15 21:12:33,057 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=93, ppid=92, state=SUCCESS; OpenRegionProcedure 6ca340acf4d63312d822bf8e2b9da104, server=jenkins-hbase4.apache.org,39075,1689455452043 in 178 msec 2023-07-15 21:12:33,057 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=94, resume processing ppid=91 2023-07-15 21:12:33,058 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=94, ppid=91, state=SUCCESS; OpenRegionProcedure c2ab947ec4d68b6742a54dbdc97c072d, server=jenkins-hbase4.apache.org,39587,1689455451998 in 177 msec 2023-07-15 21:12:33,058 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=92, ppid=90, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=6ca340acf4d63312d822bf8e2b9da104, ASSIGN in 346 msec 2023-07-15 21:12:33,059 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=91, resume processing ppid=90 2023-07-15 21:12:33,060 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=91, ppid=90, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=c2ab947ec4d68b6742a54dbdc97c072d, ASSIGN in 347 msec 2023-07-15 21:12:33,060 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-15 21:12:33,060 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689455553060"}]},"ts":"1689455553060"} 2023-07-15 21:12:33,061 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=ENABLED in hbase:meta 2023-07-15 21:12:33,065 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_POST_OPERATION 2023-07-15 21:12:33,065 DEBUG [PEWorker-3] access.PermissionStorage(175): Writing permission with rowKey testtb-testEmptyExportFileSystemState jenkins: RWXCA 2023-07-15 21:12:33,067 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=39075] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-07-15 21:12:33,070 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): regionserver:39587-0x1016ad2d8bb0002, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 21:12:33,070 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): regionserver:37853-0x1016ad2d8bb0001, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 21:12:33,070 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): master:36465-0x1016ad2d8bb0000, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 21:12:33,070 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): regionserver:39075-0x1016ad2d8bb0003, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 21:12:33,071 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-15 21:12:33,072 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-15 21:12:33,072 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-15 21:12:33,072 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-15 21:12:33,074 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=90, state=SUCCESS; CreateTableProcedure table=testtb-testEmptyExportFileSystemState in 476 msec 2023-07-15 21:12:33,210 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36465] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-15 21:12:33,210 INFO [Listener at jenkins-hbase4.apache.org/41711] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 90 completed 2023-07-15 21:12:33,213 DEBUG [Listener at jenkins-hbase4.apache.org/41711] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testEmptyExportFileSystemState 2023-07-15 21:12:33,213 DEBUG [Listener at jenkins-hbase4.apache.org/41711] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testEmptyExportFileSystemState,,1689455552596.c2ab947ec4d68b6742a54dbdc97c072d. 2023-07-15 21:12:33,215 INFO [Listener at jenkins-hbase4.apache.org/41711] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-15 21:12:33,233 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36465] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-15 21:12:33,233 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36465] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689455553233 (current time:1689455553233). 2023-07-15 21:12:33,233 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36465] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-15 21:12:33,233 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36465] zookeeper.ReadOnlyZKClient(139): Connect 0x1b6ddf04 to 127.0.0.1:50024 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-15 21:12:33,246 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36465] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3e81e14d, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-15 21:12:33,252 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36465] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-15 21:12:33,265 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:58340, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-15 21:12:33,267 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36465] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1b6ddf04 to 127.0.0.1:50024 2023-07-15 21:12:33,267 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36465] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-15 21:12:33,267 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36465] zookeeper.ReadOnlyZKClient(139): Connect 0x5ffab5ea to 127.0.0.1:50024 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-15 21:12:33,282 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36465] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2a9ad4ee, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-15 21:12:33,284 DEBUG [hconnection-0x1ba0c379-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-15 21:12:33,287 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:58350, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-15 21:12:33,293 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36465] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5ffab5ea to 127.0.0.1:50024 2023-07-15 21:12:33,294 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36465] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-15 21:12:33,294 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36465] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-07-15 21:12:33,294 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36465] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-15 21:12:33,295 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36465] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-15 21:12:33,297 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36465] procedure2.ProcedureExecutor(1029): Stored pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-15 21:12:33,298 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-15 21:12:33,300 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=95, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1689456153300 2023-07-15 21:12:33,301 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36465] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-15 21:12:33,301 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState 2023-07-15 21:12:33,304 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=96, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-15 21:12:33,304 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=95, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-15 21:12:33,307 DEBUG [Listener at jenkins-hbase4.apache.org/41711] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-15 21:12:33,307 DEBUG [Listener at jenkins-hbase4.apache.org/41711] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-15 21:12:33,309 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=95, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE in 8 msec 2023-07-15 21:12:33,313 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=96, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-15 21:12:33,314 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=96, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED; timeout=600000, timestamp=1689456153314 2023-07-15 21:12:33,328 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 21:12:33,328 INFO [(jenkins-hbase4.apache.org,36465,1689455450507)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testEmptyExportFileSystemState' 2023-07-15 21:12:33,328 DEBUG [(jenkins-hbase4.apache.org,36465,1689455450507)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 21:12:33,330 DEBUG [(jenkins-hbase4.apache.org,36465,1689455450507)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' 2023-07-15 21:12:33,330 DEBUG [(jenkins-hbase4.apache.org,36465,1689455450507)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testEmptyExportFileSystemState', kicking off acquire phase on members. 2023-07-15 21:12:33,330 DEBUG [(jenkins-hbase4.apache.org,36465,1689455450507)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36465-0x1016ad2d8bb0000, quorum=127.0.0.1:50024, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 21:12:33,330 DEBUG [(jenkins-hbase4.apache.org,36465,1689455450507)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 21:12:33,340 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): regionserver:39587-0x1016ad2d8bb0002, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 21:12:33,340 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): regionserver:39075-0x1016ad2d8bb0003, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 21:12:33,340 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 21:12:33,340 DEBUG [(jenkins-hbase4.apache.org,36465,1689455450507)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39587,1689455451998 2023-07-15 21:12:33,340 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): regionserver:37853-0x1016ad2d8bb0001, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 21:12:33,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 21:12:33,340 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 21:12:33,340 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 21:12:33,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 21:12:33,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 21:12:33,340 DEBUG [(jenkins-hbase4.apache.org,36465,1689455450507)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36465-0x1016ad2d8bb0000, quorum=127.0.0.1:50024, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39587,1689455451998 2023-07-15 21:12:33,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 21:12:33,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 21:12:33,340 DEBUG [(jenkins-hbase4.apache.org,36465,1689455450507)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39075,1689455452043 2023-07-15 21:12:33,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 21:12:33,341 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37853-0x1016ad2d8bb0001, quorum=127.0.0.1:50024, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 21:12:33,341 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39587-0x1016ad2d8bb0002, quorum=127.0.0.1:50024, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 21:12:33,341 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39075-0x1016ad2d8bb0003, quorum=127.0.0.1:50024, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 21:12:33,341 DEBUG [(jenkins-hbase4.apache.org,36465,1689455450507)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36465-0x1016ad2d8bb0000, quorum=127.0.0.1:50024, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39075,1689455452043 2023-07-15 21:12:33,341 DEBUG [(jenkins-hbase4.apache.org,36465,1689455450507)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-15 21:12:33,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-07-15 21:12:33,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 21:12:33,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-07-15 21:12:33,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 21:12:33,342 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-15 21:12:33,342 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-15 21:12:33,342 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 21:12:33,342 DEBUG [member: 'jenkins-hbase4.apache.org,37853,1689455451932' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-15 21:12:33,342 DEBUG [member: 'jenkins-hbase4.apache.org,37853,1689455451932' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 21:12:33,342 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 21:12:33,344 DEBUG [member: 'jenkins-hbase4.apache.org,37853,1689455451932' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-15 21:12:33,344 DEBUG [member: 'jenkins-hbase4.apache.org,37853,1689455451932' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-15 21:12:33,344 DEBUG [member: 'jenkins-hbase4.apache.org,37853,1689455451932' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37853,1689455451932' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-07-15 21:12:33,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-07-15 21:12:33,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 21:12:33,344 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-15 21:12:33,344 DEBUG [member: 'jenkins-hbase4.apache.org,39075,1689455452043' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-15 21:12:33,345 DEBUG [member: 'jenkins-hbase4.apache.org,39075,1689455452043' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 21:12:33,352 DEBUG [member: 'jenkins-hbase4.apache.org,39075,1689455452043' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-15 21:12:33,352 DEBUG [member: 'jenkins-hbase4.apache.org,39075,1689455452043' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-15 21:12:33,352 DEBUG [member: 'jenkins-hbase4.apache.org,39075,1689455452043' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39075,1689455452043' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-07-15 21:12:33,352 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 21:12:33,353 DEBUG [member: 'jenkins-hbase4.apache.org,39587,1689455451998' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-15 21:12:33,353 DEBUG [member: 'jenkins-hbase4.apache.org,39587,1689455451998' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 21:12:33,354 DEBUG [member: 'jenkins-hbase4.apache.org,39587,1689455451998' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-15 21:12:33,354 DEBUG [member: 'jenkins-hbase4.apache.org,39587,1689455451998' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-15 21:12:33,354 DEBUG [member: 'jenkins-hbase4.apache.org,39587,1689455451998' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39587,1689455451998' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-07-15 21:12:33,362 DEBUG [member: 'jenkins-hbase4.apache.org,37853,1689455451932' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 21:12:33,363 DEBUG [member: 'jenkins-hbase4.apache.org,39075,1689455452043' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 21:12:33,363 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): master:36465-0x1016ad2d8bb0000, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39075,1689455452043 2023-07-15 21:12:33,363 DEBUG [member: 'jenkins-hbase4.apache.org,37853,1689455451932' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37853-0x1016ad2d8bb0001, quorum=127.0.0.1:50024, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 21:12:33,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39075,1689455452043 2023-07-15 21:12:33,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 21:12:33,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 21:12:33,363 DEBUG [member: 'jenkins-hbase4.apache.org,37853,1689455451932' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-15 21:12:33,365 DEBUG [member: 'jenkins-hbase4.apache.org,39075,1689455452043' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39075-0x1016ad2d8bb0003, quorum=127.0.0.1:50024, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 21:12:33,365 DEBUG [member: 'jenkins-hbase4.apache.org,39075,1689455452043' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-15 21:12:33,365 DEBUG [member: 'jenkins-hbase4.apache.org,39587,1689455451998' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 21:12:33,365 DEBUG [member: 'jenkins-hbase4.apache.org,39587,1689455451998' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39587-0x1016ad2d8bb0002, quorum=127.0.0.1:50024, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 21:12:33,365 DEBUG [member: 'jenkins-hbase4.apache.org,39587,1689455451998' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-15 21:12:33,367 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): master:36465-0x1016ad2d8bb0000, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39587,1689455451998 2023-07-15 21:12:33,367 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 21:12:33,380 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 21:12:33,380 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 21:12:33,380 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39075,1689455452043 2023-07-15 21:12:33,381 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39587,1689455451998 2023-07-15 21:12:33,381 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37853,1689455451932 2023-07-15 21:12:33,381 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 21:12:33,382 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39075,1689455452043' joining acquired barrier for procedure 'emptySnaptb0-testEmptyExportFileSystemState' on coordinator 2023-07-15 21:12:33,382 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5b878035[Count = 1] remaining members to acquire global barrier 2023-07-15 21:12:33,382 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39587,1689455451998 2023-07-15 21:12:33,382 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 21:12:33,382 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 21:12:33,382 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 21:12:33,383 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 21:12:33,383 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 21:12:33,383 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39075,1689455452043 2023-07-15 21:12:33,383 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39587,1689455451998 2023-07-15 21:12:33,384 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37853,1689455451932 2023-07-15 21:12:33,384 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 21:12:33,384 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39587,1689455451998' joining acquired barrier for procedure 'emptySnaptb0-testEmptyExportFileSystemState' on coordinator 2023-07-15 21:12:33,384 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5b878035[Count = 0] remaining members to acquire global barrier 2023-07-15 21:12:33,384 DEBUG [(jenkins-hbase4.apache.org,36465,1689455450507)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'in-barrier' execution. 2023-07-15 21:12:33,384 DEBUG [(jenkins-hbase4.apache.org,36465,1689455450507)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 21:12:33,386 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): regionserver:39075-0x1016ad2d8bb0003, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 21:12:33,386 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): regionserver:39587-0x1016ad2d8bb0002, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 21:12:33,386 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): regionserver:37853-0x1016ad2d8bb0001, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 21:12:33,386 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 21:12:33,386 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 21:12:33,386 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 21:12:33,386 DEBUG [(jenkins-hbase4.apache.org,36465,1689455450507)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36465-0x1016ad2d8bb0000, quorum=127.0.0.1:50024, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39075,1689455452043 2023-07-15 21:12:33,386 DEBUG [member: 'jenkins-hbase4.apache.org,39587,1689455451998' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-15 21:12:33,386 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 21:12:33,386 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 21:12:33,387 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 21:12:33,387 DEBUG [member: 'jenkins-hbase4.apache.org,39075,1689455452043' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-15 21:12:33,387 DEBUG [(jenkins-hbase4.apache.org,36465,1689455450507)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36465-0x1016ad2d8bb0000, quorum=127.0.0.1:50024, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39587,1689455451998 2023-07-15 21:12:33,387 DEBUG [member: 'jenkins-hbase4.apache.org,39587,1689455451998' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-15 21:12:33,387 DEBUG [member: 'jenkins-hbase4.apache.org,39587,1689455451998' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-15 21:12:33,387 DEBUG [(jenkins-hbase4.apache.org,36465,1689455450507)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-15 21:12:33,387 DEBUG [rs(jenkins-hbase4.apache.org,39587,1689455451998)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,,1689455552596.c2ab947ec4d68b6742a54dbdc97c072d. 2023-07-15 21:12:33,387 DEBUG [member: 'jenkins-hbase4.apache.org,37853,1689455451932' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-15 21:12:33,387 DEBUG [rs(jenkins-hbase4.apache.org,39587,1689455451998)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1689455552596.c2ab947ec4d68b6742a54dbdc97c072d. started... 2023-07-15 21:12:33,387 DEBUG [member: 'jenkins-hbase4.apache.org,37853,1689455451932' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-07-15 21:12:33,387 DEBUG [member: 'jenkins-hbase4.apache.org,37853,1689455451932' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,37853,1689455451932' in zk 2023-07-15 21:12:33,387 DEBUG [rs(jenkins-hbase4.apache.org,39587,1689455451998)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for c2ab947ec4d68b6742a54dbdc97c072d: 2023-07-15 21:12:33,387 DEBUG [rs(jenkins-hbase4.apache.org,39587,1689455451998)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,,1689455552596.c2ab947ec4d68b6742a54dbdc97c072d.' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 21:12:33,387 DEBUG [rs(jenkins-hbase4.apache.org,39587,1689455451998)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-15 21:12:33,387 DEBUG [rs(jenkins-hbase4.apache.org,39587,1689455451998)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-15 21:12:33,388 DEBUG [member: 'jenkins-hbase4.apache.org,39075,1689455452043' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-15 21:12:33,388 DEBUG [member: 'jenkins-hbase4.apache.org,39075,1689455452043' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-15 21:12:33,388 DEBUG [rs(jenkins-hbase4.apache.org,39075,1689455452043)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,1,1689455552596.6ca340acf4d63312d822bf8e2b9da104. 2023-07-15 21:12:33,388 DEBUG [rs(jenkins-hbase4.apache.org,39075,1689455452043)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1689455552596.6ca340acf4d63312d822bf8e2b9da104. started... 2023-07-15 21:12:33,390 DEBUG [rs(jenkins-hbase4.apache.org,39075,1689455452043)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 6ca340acf4d63312d822bf8e2b9da104: 2023-07-15 21:12:33,390 DEBUG [rs(jenkins-hbase4.apache.org,39075,1689455452043)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,1,1689455552596.6ca340acf4d63312d822bf8e2b9da104.' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 21:12:33,391 DEBUG [rs(jenkins-hbase4.apache.org,39075,1689455452043)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-15 21:12:33,392 DEBUG [rs(jenkins-hbase4.apache.org,39075,1689455452043)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-15 21:12:33,392 DEBUG [member: 'jenkins-hbase4.apache.org,37853,1689455451932' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-15 21:12:33,392 DEBUG [member: 'jenkins-hbase4.apache.org,37853,1689455451932' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 21:12:33,392 DEBUG [member: 'jenkins-hbase4.apache.org,37853,1689455451932' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-07-15 21:12:33,405 DEBUG [rs(jenkins-hbase4.apache.org,39075,1689455452043)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1689455552596.6ca340acf4d63312d822bf8e2b9da104. completed. 2023-07-15 21:12:33,405 DEBUG [rs(jenkins-hbase4.apache.org,39075,1689455452043)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,1,1689455552596.6ca340acf4d63312d822bf8e2b9da104. 2023-07-15 21:12:33,405 DEBUG [member: 'jenkins-hbase4.apache.org,39075,1689455452043' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-15 21:12:33,405 DEBUG [member: 'jenkins-hbase4.apache.org,39075,1689455452043' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-15 21:12:33,405 DEBUG [member: 'jenkins-hbase4.apache.org,39075,1689455452043' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,39075,1689455452043 2023-07-15 21:12:33,406 DEBUG [member: 'jenkins-hbase4.apache.org,39075,1689455452043' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-07-15 21:12:33,406 DEBUG [member: 'jenkins-hbase4.apache.org,39075,1689455452043' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,39075,1689455452043' in zk 2023-07-15 21:12:33,407 DEBUG [Listener at jenkins-hbase4.apache.org/41711] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-15 21:12:33,407 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): master:36465-0x1016ad2d8bb0000, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39075,1689455452043 2023-07-15 21:12:33,407 DEBUG [member: 'jenkins-hbase4.apache.org,39075,1689455452043' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-15 21:12:33,407 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39075,1689455452043 2023-07-15 21:12:33,407 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 21:12:33,407 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 21:12:33,407 DEBUG [member: 'jenkins-hbase4.apache.org,39075,1689455452043' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 21:12:33,407 DEBUG [member: 'jenkins-hbase4.apache.org,39075,1689455452043' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-07-15 21:12:33,408 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36465] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-15 21:12:33,408 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 21:12:33,408 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36465] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-15 21:12:33,408 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 21:12:33,408 DEBUG [Listener at jenkins-hbase4.apache.org/41711] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-15 21:12:33,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 21:12:33,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39075,1689455452043 2023-07-15 21:12:33,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39587,1689455451998 2023-07-15 21:12:33,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37853,1689455451932 2023-07-15 21:12:33,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 21:12:33,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 21:12:33,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39075,1689455452043 2023-07-15 21:12:33,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37853,1689455451932 2023-07-15 21:12:33,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,39075,1689455452043': 2023-07-15 21:12:33,411 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39075,1689455452043' released barrier for procedure'emptySnaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 1 more 2023-07-15 21:12:33,427 DEBUG [rs(jenkins-hbase4.apache.org,39587,1689455451998)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1689455552596.c2ab947ec4d68b6742a54dbdc97c072d. completed. 2023-07-15 21:12:33,427 DEBUG [rs(jenkins-hbase4.apache.org,39587,1689455451998)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,,1689455552596.c2ab947ec4d68b6742a54dbdc97c072d. 2023-07-15 21:12:33,427 DEBUG [member: 'jenkins-hbase4.apache.org,39587,1689455451998' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-15 21:12:33,427 DEBUG [member: 'jenkins-hbase4.apache.org,39587,1689455451998' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-15 21:12:33,427 DEBUG [member: 'jenkins-hbase4.apache.org,39587,1689455451998' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,39587,1689455451998 2023-07-15 21:12:33,427 DEBUG [member: 'jenkins-hbase4.apache.org,39587,1689455451998' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-07-15 21:12:33,427 DEBUG [member: 'jenkins-hbase4.apache.org,39587,1689455451998' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,39587,1689455451998' in zk 2023-07-15 21:12:33,429 DEBUG [member: 'jenkins-hbase4.apache.org,39587,1689455451998' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-15 21:12:33,429 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): master:36465-0x1016ad2d8bb0000, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39587,1689455451998 2023-07-15 21:12:33,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39587,1689455451998 2023-07-15 21:12:33,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 21:12:33,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 21:12:33,429 DEBUG [member: 'jenkins-hbase4.apache.org,39587,1689455451998' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 21:12:33,429 DEBUG [member: 'jenkins-hbase4.apache.org,39587,1689455451998' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-07-15 21:12:33,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 21:12:33,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 21:12:33,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 21:12:33,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39075,1689455452043 2023-07-15 21:12:33,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39587,1689455451998 2023-07-15 21:12:33,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37853,1689455451932 2023-07-15 21:12:33,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 21:12:33,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 21:12:33,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39075,1689455452043 2023-07-15 21:12:33,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39587,1689455451998 2023-07-15 21:12:33,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37853,1689455451932 2023-07-15 21:12:33,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,39587,1689455451998': 2023-07-15 21:12:33,434 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39587,1689455451998' released barrier for procedure'emptySnaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 0 more 2023-07-15 21:12:33,435 INFO [(jenkins-hbase4.apache.org,36465,1689455450507)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' execution completed 2023-07-15 21:12:33,435 DEBUG [(jenkins-hbase4.apache.org,36465,1689455450507)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-15 21:12:33,435 DEBUG [(jenkins-hbase4.apache.org,36465,1689455450507)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-15 21:12:33,435 DEBUG [(jenkins-hbase4.apache.org,36465,1689455450507)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 21:12:33,435 INFO [(jenkins-hbase4.apache.org,36465,1689455450507)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testEmptyExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-15 21:12:33,437 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): regionserver:37853-0x1016ad2d8bb0001, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 21:12:33,437 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): regionserver:39075-0x1016ad2d8bb0003, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 21:12:33,437 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): regionserver:39587-0x1016ad2d8bb0002, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 21:12:33,437 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): regionserver:39075-0x1016ad2d8bb0003, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 21:12:33,437 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): master:36465-0x1016ad2d8bb0000, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 21:12:33,437 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 21:12:33,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 21:12:33,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 21:12:33,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 21:12:33,437 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 21:12:33,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 21:12:33,437 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 21:12:33,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 21:12:33,437 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): regionserver:39587-0x1016ad2d8bb0002, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 21:12:33,437 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): regionserver:37853-0x1016ad2d8bb0001, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 21:12:33,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 21:12:33,437 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 21:12:33,437 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 21:12:33,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 21:12:33,437 DEBUG [(jenkins-hbase4.apache.org,36465,1689455450507)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36465-0x1016ad2d8bb0000, quorum=127.0.0.1:50024, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39075,1689455452043 2023-07-15 21:12:33,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 21:12:33,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 21:12:33,437 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 21:12:33,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 21:12:33,438 DEBUG [(jenkins-hbase4.apache.org,36465,1689455450507)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36465-0x1016ad2d8bb0000, quorum=127.0.0.1:50024, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39587,1689455451998 2023-07-15 21:12:33,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 21:12:33,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 21:12:33,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 21:12:33,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 21:12:33,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 21:12:33,438 DEBUG [(jenkins-hbase4.apache.org,36465,1689455450507)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36465-0x1016ad2d8bb0000, quorum=127.0.0.1:50024, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37853,1689455451932 2023-07-15 21:12:33,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 21:12:33,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39075,1689455452043 2023-07-15 21:12:33,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39587,1689455451998 2023-07-15 21:12:33,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37853,1689455451932 2023-07-15 21:12:33,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 21:12:33,440 DEBUG [(jenkins-hbase4.apache.org,36465,1689455450507)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36465-0x1016ad2d8bb0000, quorum=127.0.0.1:50024, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39075,1689455452043 2023-07-15 21:12:33,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 21:12:33,440 DEBUG [(jenkins-hbase4.apache.org,36465,1689455450507)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36465-0x1016ad2d8bb0000, quorum=127.0.0.1:50024, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39587,1689455451998 2023-07-15 21:12:33,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39075,1689455452043 2023-07-15 21:12:33,440 DEBUG [(jenkins-hbase4.apache.org,36465,1689455450507)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36465-0x1016ad2d8bb0000, quorum=127.0.0.1:50024, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37853,1689455451932 2023-07-15 21:12:33,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39587,1689455451998 2023-07-15 21:12:33,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37853,1689455451932 2023-07-15 21:12:33,444 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): master:36465-0x1016ad2d8bb0000, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37853,1689455451932 2023-07-15 21:12:33,444 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): master:36465-0x1016ad2d8bb0000, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 21:12:33,444 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): master:36465-0x1016ad2d8bb0000, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39587,1689455451998 2023-07-15 21:12:33,444 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): regionserver:39587-0x1016ad2d8bb0002, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 21:12:33,444 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): master:36465-0x1016ad2d8bb0000, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39075,1689455452043 2023-07-15 21:12:33,444 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 21:12:33,444 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): regionserver:37853-0x1016ad2d8bb0001, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 21:12:33,444 DEBUG [(jenkins-hbase4.apache.org,36465,1689455450507)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 21:12:33,444 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): regionserver:37853-0x1016ad2d8bb0001, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 21:12:33,444 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 21:12:33,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 21:12:33,444 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 21:12:33,445 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testEmptyExportFileSystemState 2023-07-15 21:12:33,444 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): regionserver:39587-0x1016ad2d8bb0002, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 21:12:33,444 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): regionserver:39075-0x1016ad2d8bb0003, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 21:12:33,445 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): regionserver:39075-0x1016ad2d8bb0003, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 21:12:33,445 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 21:12:33,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 21:12:33,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 21:12:33,447 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 37e3865d2ff7e5e2da33a03e3f723df0, NAME => 'testtb-testEmptyExportFileSystemState,.mob,0.37e3865d2ff7e5e2da33a03e3f723df0.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 21:12:33,444 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): master:36465-0x1016ad2d8bb0000, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 21:12:33,447 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-15 21:12:33,447 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): master:36465-0x1016ad2d8bb0000, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37853,1689455451932 2023-07-15 21:12:33,447 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): master:36465-0x1016ad2d8bb0000, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 21:12:33,447 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): master:36465-0x1016ad2d8bb0000, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39587,1689455451998 2023-07-15 21:12:33,447 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): master:36465-0x1016ad2d8bb0000, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39075,1689455452043 2023-07-15 21:12:33,447 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): master:36465-0x1016ad2d8bb0000, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 21:12:33,447 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): master:36465-0x1016ad2d8bb0000, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 21:12:33,447 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 21:12:33,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 21:12:33,447 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-07-15 21:12:33,447 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 21:12:33,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 21:12:33,447 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 21:12:33,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 21:12:33,483 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 21:12:33,484 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 21:12:33,531 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState to hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 21:12:33,572 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed 2023-07-15 21:12:33,572 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 21:12:33,573 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 21:12:33,573 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState at 1689455553301Completed referencing HFiles for the mob region of table: testtb-testEmptyExportFileSystemState at 1689455553483 (+182 ms)Consolidate snapshot: emptySnaptb0-testEmptyExportFileSystemState at 1689455553483Loading Region manifests for emptySnaptb0-testEmptyExportFileSystemState at 1689455553483Writing data manifest for emptySnaptb0-testEmptyExportFileSystemState at 1689455553499 (+16 ms)Verifying snapshot: emptySnaptb0-testEmptyExportFileSystemState at 1689455553523 (+24 ms)Snapshot emptySnaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed at 1689455553572 (+49 ms) 2023-07-15 21:12:33,578 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=96, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-15 21:12:33,579 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=96, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED in 276 msec 2023-07-15 21:12:33,609 DEBUG [Listener at jenkins-hbase4.apache.org/41711] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-15 21:12:33,612 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36465] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-15 21:12:33,612 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36465] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-15 21:12:33,617 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39075] regionserver.HRegion(8805): writing data to region testtb-testEmptyExportFileSystemState,1,1689455552596.6ca340acf4d63312d822bf8e2b9da104. with WAL disabled. Data may be lost in the event of a crash. 2023-07-15 21:12:33,626 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39587] regionserver.HRegion(8805): writing data to region testtb-testEmptyExportFileSystemState,,1689455552596.c2ab947ec4d68b6742a54dbdc97c072d. with WAL disabled. Data may be lost in the event of a crash. 2023-07-15 21:12:33,632 DEBUG [Listener at jenkins-hbase4.apache.org/41711] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testEmptyExportFileSystemState 2023-07-15 21:12:33,632 DEBUG [Listener at jenkins-hbase4.apache.org/41711] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testEmptyExportFileSystemState,,1689455552596.c2ab947ec4d68b6742a54dbdc97c072d. 2023-07-15 21:12:33,632 INFO [Listener at jenkins-hbase4.apache.org/41711] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-15 21:12:33,645 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36465] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-15 21:12:33,645 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36465] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689455553645 (current time:1689455553645). 2023-07-15 21:12:33,645 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36465] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-15 21:12:33,646 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36465] zookeeper.ReadOnlyZKClient(139): Connect 0x444452eb to 127.0.0.1:50024 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-15 21:12:33,680 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36465] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@59e2fa11, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-15 21:12:33,682 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36465] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-15 21:12:33,684 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:58362, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-15 21:12:33,685 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36465] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x444452eb to 127.0.0.1:50024 2023-07-15 21:12:33,685 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36465] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-15 21:12:33,685 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36465] zookeeper.ReadOnlyZKClient(139): Connect 0x2ef89d7e to 127.0.0.1:50024 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-15 21:12:33,694 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36465] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@48cd5140, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-15 21:12:33,802 DEBUG [hconnection-0x631183a-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-15 21:12:33,806 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:58376, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-15 21:12:33,815 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36465] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2ef89d7e to 127.0.0.1:50024 2023-07-15 21:12:33,815 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36465] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-15 21:12:33,815 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36465] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-07-15 21:12:33,816 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36465] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-15 21:12:33,816 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36465] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-15 21:12:33,820 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36465] procedure2.ProcedureExecutor(1029): Stored pid=97, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-15 21:12:33,821 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=97, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-15 21:12:33,823 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36465] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-15 21:12:33,823 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=97, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1689456153822 2023-07-15 21:12:33,823 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState 2023-07-15 21:12:33,823 DEBUG [Listener at jenkins-hbase4.apache.org/41711] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-15 21:12:33,823 DEBUG [Listener at jenkins-hbase4.apache.org/41711] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-15 21:12:33,836 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=97, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-15 21:12:33,836 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=98, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-15 21:12:33,838 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=97, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE in 19 msec 2023-07-15 21:12:33,839 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=98, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-15 21:12:33,840 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=98, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED; timeout=600000, timestamp=1689456153840 2023-07-15 21:12:33,923 DEBUG [Listener at jenkins-hbase4.apache.org/41711] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-15 21:12:33,925 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36465] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-15 21:12:33,925 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36465] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-15 21:12:33,925 DEBUG [Listener at jenkins-hbase4.apache.org/41711] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-15 21:12:34,125 DEBUG [Listener at jenkins-hbase4.apache.org/41711] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-15 21:12:34,126 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36465] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-15 21:12:34,127 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36465] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-15 21:12:34,127 DEBUG [Listener at jenkins-hbase4.apache.org/41711] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-15 21:12:34,266 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testEmptyExportFileSystemState 2023-07-15 21:12:34,267 INFO [(jenkins-hbase4.apache.org,36465,1689455450507)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testEmptyExportFileSystemState' 2023-07-15 21:12:34,267 DEBUG [(jenkins-hbase4.apache.org,36465,1689455450507)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 21:12:34,267 DEBUG [(jenkins-hbase4.apache.org,36465,1689455450507)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' 2023-07-15 21:12:34,267 DEBUG [(jenkins-hbase4.apache.org,36465,1689455450507)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testEmptyExportFileSystemState', kicking off acquire phase on members. 2023-07-15 21:12:34,267 DEBUG [(jenkins-hbase4.apache.org,36465,1689455450507)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36465-0x1016ad2d8bb0000, quorum=127.0.0.1:50024, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-15 21:12:34,267 DEBUG [(jenkins-hbase4.apache.org,36465,1689455450507)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-15 21:12:34,269 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): regionserver:37853-0x1016ad2d8bb0001, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 21:12:34,269 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): regionserver:39075-0x1016ad2d8bb0003, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 21:12:34,269 DEBUG [(jenkins-hbase4.apache.org,36465,1689455450507)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39587,1689455451998 2023-07-15 21:12:34,269 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 21:12:34,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 21:12:34,269 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 21:12:34,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 21:12:34,269 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): regionserver:39587-0x1016ad2d8bb0002, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 21:12:34,269 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 21:12:34,269 DEBUG [(jenkins-hbase4.apache.org,36465,1689455450507)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36465-0x1016ad2d8bb0000, quorum=127.0.0.1:50024, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39587,1689455451998 2023-07-15 21:12:34,269 DEBUG [(jenkins-hbase4.apache.org,36465,1689455450507)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39075,1689455452043 2023-07-15 21:12:34,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 21:12:34,270 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-15 21:12:34,270 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-15 21:12:34,270 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-15 21:12:34,270 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37853-0x1016ad2d8bb0001, quorum=127.0.0.1:50024, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-15 21:12:34,270 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39075-0x1016ad2d8bb0003, quorum=127.0.0.1:50024, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-15 21:12:34,270 DEBUG [(jenkins-hbase4.apache.org,36465,1689455450507)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36465-0x1016ad2d8bb0000, quorum=127.0.0.1:50024, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39075,1689455452043 2023-07-15 21:12:34,270 DEBUG [(jenkins-hbase4.apache.org,36465,1689455450507)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-15 21:12:34,270 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-07-15 21:12:34,270 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-15 21:12:34,271 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39587-0x1016ad2d8bb0002, quorum=127.0.0.1:50024, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-15 21:12:34,271 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-15 21:12:34,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-07-15 21:12:34,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-15 21:12:34,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-07-15 21:12:34,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-15 21:12:34,271 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-15 21:12:34,271 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-15 21:12:34,274 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-07-15 21:12:34,274 DEBUG [member: 'jenkins-hbase4.apache.org,37853,1689455451932' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-15 21:12:34,274 DEBUG [member: 'jenkins-hbase4.apache.org,37853,1689455451932' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 21:12:34,274 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-07-15 21:12:34,275 DEBUG [member: 'jenkins-hbase4.apache.org,39075,1689455452043' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-15 21:12:34,275 DEBUG [member: 'jenkins-hbase4.apache.org,39075,1689455452043' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 21:12:34,281 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-07-15 21:12:34,281 DEBUG [member: 'jenkins-hbase4.apache.org,39075,1689455452043' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-15 21:12:34,282 DEBUG [member: 'jenkins-hbase4.apache.org,39075,1689455452043' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-15 21:12:34,281 DEBUG [member: 'jenkins-hbase4.apache.org,39587,1689455451998' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-15 21:12:34,281 DEBUG [member: 'jenkins-hbase4.apache.org,37853,1689455451932' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-15 21:12:34,282 DEBUG [member: 'jenkins-hbase4.apache.org,39587,1689455451998' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 21:12:34,282 DEBUG [member: 'jenkins-hbase4.apache.org,39075,1689455452043' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39075,1689455452043' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-07-15 21:12:34,285 DEBUG [member: 'jenkins-hbase4.apache.org,39587,1689455451998' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-15 21:12:34,286 DEBUG [member: 'jenkins-hbase4.apache.org,39587,1689455451998' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-15 21:12:34,286 DEBUG [member: 'jenkins-hbase4.apache.org,39587,1689455451998' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39587,1689455451998' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-07-15 21:12:34,282 DEBUG [member: 'jenkins-hbase4.apache.org,37853,1689455451932' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-15 21:12:34,287 DEBUG [member: 'jenkins-hbase4.apache.org,37853,1689455451932' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37853,1689455451932' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-07-15 21:12:34,288 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): master:36465-0x1016ad2d8bb0000, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39075,1689455452043 2023-07-15 21:12:34,288 DEBUG [member: 'jenkins-hbase4.apache.org,39075,1689455452043' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-15 21:12:34,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39075,1689455452043 2023-07-15 21:12:34,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 21:12:34,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 21:12:34,289 DEBUG [member: 'jenkins-hbase4.apache.org,37853,1689455451932' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-15 21:12:34,290 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): master:36465-0x1016ad2d8bb0000, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39587,1689455451998 2023-07-15 21:12:34,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 21:12:34,290 DEBUG [member: 'jenkins-hbase4.apache.org,39587,1689455451998' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-15 21:12:34,290 DEBUG [member: 'jenkins-hbase4.apache.org,39075,1689455452043' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39075-0x1016ad2d8bb0003, quorum=127.0.0.1:50024, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-15 21:12:34,290 DEBUG [member: 'jenkins-hbase4.apache.org,39075,1689455452043' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-15 21:12:34,290 DEBUG [member: 'jenkins-hbase4.apache.org,37853,1689455451932' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37853-0x1016ad2d8bb0001, quorum=127.0.0.1:50024, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-15 21:12:34,290 DEBUG [member: 'jenkins-hbase4.apache.org,37853,1689455451932' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-15 21:12:34,290 DEBUG [member: 'jenkins-hbase4.apache.org,39587,1689455451998' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39587-0x1016ad2d8bb0002, quorum=127.0.0.1:50024, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-15 21:12:34,290 DEBUG [member: 'jenkins-hbase4.apache.org,39587,1689455451998' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-15 21:12:34,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 21:12:34,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-15 21:12:34,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39075,1689455452043 2023-07-15 21:12:34,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39587,1689455451998 2023-07-15 21:12:34,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37853,1689455451932 2023-07-15 21:12:34,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 21:12:34,293 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39075,1689455452043' joining acquired barrier for procedure 'snaptb0-testEmptyExportFileSystemState' on coordinator 2023-07-15 21:12:34,293 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2757e707[Count = 1] remaining members to acquire global barrier 2023-07-15 21:12:34,293 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39587,1689455451998 2023-07-15 21:12:34,293 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 21:12:34,293 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 21:12:34,293 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 21:12:34,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 21:12:34,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-15 21:12:34,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39075,1689455452043 2023-07-15 21:12:34,296 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39587,1689455451998 2023-07-15 21:12:34,296 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37853,1689455451932 2023-07-15 21:12:34,296 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 21:12:34,297 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39587,1689455451998' joining acquired barrier for procedure 'snaptb0-testEmptyExportFileSystemState' on coordinator 2023-07-15 21:12:34,297 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2757e707[Count = 0] remaining members to acquire global barrier 2023-07-15 21:12:34,297 DEBUG [(jenkins-hbase4.apache.org,36465,1689455450507)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testEmptyExportFileSystemState' starting 'in-barrier' execution. 2023-07-15 21:12:34,297 DEBUG [(jenkins-hbase4.apache.org,36465,1689455450507)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-15 21:12:34,302 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): regionserver:37853-0x1016ad2d8bb0001, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-15 21:12:34,302 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-15 21:12:34,302 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): regionserver:39587-0x1016ad2d8bb0002, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-15 21:12:34,302 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-15 21:12:34,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-15 21:12:34,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-15 21:12:34,302 DEBUG [member: 'jenkins-hbase4.apache.org,39587,1689455451998' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-15 21:12:34,302 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): regionserver:39075-0x1016ad2d8bb0003, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-15 21:12:34,302 DEBUG [member: 'jenkins-hbase4.apache.org,37853,1689455451932' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-15 21:12:34,302 DEBUG [member: 'jenkins-hbase4.apache.org,37853,1689455451932' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-07-15 21:12:34,303 DEBUG [member: 'jenkins-hbase4.apache.org,37853,1689455451932' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,37853,1689455451932' in zk 2023-07-15 21:12:34,302 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-15 21:12:34,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-15 21:12:34,303 DEBUG [member: 'jenkins-hbase4.apache.org,39075,1689455452043' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-15 21:12:34,303 DEBUG [(jenkins-hbase4.apache.org,36465,1689455450507)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36465-0x1016ad2d8bb0000, quorum=127.0.0.1:50024, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39075,1689455452043 2023-07-15 21:12:34,305 DEBUG [member: 'jenkins-hbase4.apache.org,39587,1689455451998' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-15 21:12:34,305 DEBUG [member: 'jenkins-hbase4.apache.org,39587,1689455451998' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-15 21:12:34,305 DEBUG [rs(jenkins-hbase4.apache.org,39587,1689455451998)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,,1689455552596.c2ab947ec4d68b6742a54dbdc97c072d. 2023-07-15 21:12:34,306 DEBUG [rs(jenkins-hbase4.apache.org,39587,1689455451998)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1689455552596.c2ab947ec4d68b6742a54dbdc97c072d. started... 2023-07-15 21:12:34,306 INFO [rs(jenkins-hbase4.apache.org,39587,1689455451998)-snapshot-pool-0] regionserver.HRegion(2745): Flushing c2ab947ec4d68b6742a54dbdc97c072d 1/1 column families, dataSize=199 B heapSize=688 B 2023-07-15 21:12:34,306 DEBUG [member: 'jenkins-hbase4.apache.org,39075,1689455452043' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-15 21:12:34,306 DEBUG [member: 'jenkins-hbase4.apache.org,39075,1689455452043' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-15 21:12:34,306 DEBUG [rs(jenkins-hbase4.apache.org,39075,1689455452043)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,1,1689455552596.6ca340acf4d63312d822bf8e2b9da104. 2023-07-15 21:12:34,306 DEBUG [rs(jenkins-hbase4.apache.org,39075,1689455452043)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1689455552596.6ca340acf4d63312d822bf8e2b9da104. started... 2023-07-15 21:12:34,307 INFO [rs(jenkins-hbase4.apache.org,39075,1689455452043)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 6ca340acf4d63312d822bf8e2b9da104 1/1 column families, dataSize=3.06 KB heapSize=6.86 KB 2023-07-15 21:12:34,308 DEBUG [member: 'jenkins-hbase4.apache.org,37853,1689455451932' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-15 21:12:34,308 DEBUG [(jenkins-hbase4.apache.org,36465,1689455450507)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36465-0x1016ad2d8bb0000, quorum=127.0.0.1:50024, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39587,1689455451998 2023-07-15 21:12:34,308 DEBUG [(jenkins-hbase4.apache.org,36465,1689455450507)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-15 21:12:34,308 DEBUG [member: 'jenkins-hbase4.apache.org,37853,1689455451932' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 21:12:34,308 DEBUG [member: 'jenkins-hbase4.apache.org,37853,1689455451932' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-07-15 21:12:34,341 INFO [rs(jenkins-hbase4.apache.org,39587,1689455451998)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230715100d3c0b5ab24170966349007a1b4227 to hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e20230715100d3c0b5ab24170966349007a1b4227 2023-07-15 21:12:34,346 INFO [rs(jenkins-hbase4.apache.org,39075,1689455452043)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202307151fb1911ad5174952bf23ff9316e977a8 to hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b202307151fb1911ad5174952bf23ff9316e977a8 2023-07-15 21:12:34,364 INFO [rs(jenkins-hbase4.apache.org,39587,1689455451998)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=199, hasBloomFilter=true, into tmp file hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/data/default/testtb-testEmptyExportFileSystemState/c2ab947ec4d68b6742a54dbdc97c072d/.tmp/cf/4af0c922fc7d43d6a356fe84c4d5afde 2023-07-15 21:12:34,368 INFO [rs(jenkins-hbase4.apache.org,39075,1689455452043)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/data/default/testtb-testEmptyExportFileSystemState/6ca340acf4d63312d822bf8e2b9da104/.tmp/cf/52f54335e68c42febd7a874463e432cd 2023-07-15 21:12:34,370 DEBUG [rs(jenkins-hbase4.apache.org,39587,1689455451998)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/data/default/testtb-testEmptyExportFileSystemState/c2ab947ec4d68b6742a54dbdc97c072d/.tmp/cf/4af0c922fc7d43d6a356fe84c4d5afde as hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/data/default/testtb-testEmptyExportFileSystemState/c2ab947ec4d68b6742a54dbdc97c072d/cf/4af0c922fc7d43d6a356fe84c4d5afde 2023-07-15 21:12:34,374 DEBUG [rs(jenkins-hbase4.apache.org,39075,1689455452043)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/data/default/testtb-testEmptyExportFileSystemState/6ca340acf4d63312d822bf8e2b9da104/.tmp/cf/52f54335e68c42febd7a874463e432cd as hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/data/default/testtb-testEmptyExportFileSystemState/6ca340acf4d63312d822bf8e2b9da104/cf/52f54335e68c42febd7a874463e432cd 2023-07-15 21:12:34,380 INFO [rs(jenkins-hbase4.apache.org,39587,1689455451998)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/data/default/testtb-testEmptyExportFileSystemState/c2ab947ec4d68b6742a54dbdc97c072d/cf/4af0c922fc7d43d6a356fe84c4d5afde, entries=3, sequenceid=6, filesize=5.4 K 2023-07-15 21:12:34,380 INFO [rs(jenkins-hbase4.apache.org,39075,1689455452043)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/data/default/testtb-testEmptyExportFileSystemState/6ca340acf4d63312d822bf8e2b9da104/cf/52f54335e68c42febd7a874463e432cd, entries=47, sequenceid=6, filesize=13.1 K 2023-07-15 21:12:34,381 INFO [rs(jenkins-hbase4.apache.org,39587,1689455451998)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~199 B/199, heapSize ~672 B/672, currentSize=0 B/0 for c2ab947ec4d68b6742a54dbdc97c072d in 75ms, sequenceid=6, compaction requested=false 2023-07-15 21:12:34,381 DEBUG [rs(jenkins-hbase4.apache.org,39587,1689455451998)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testEmptyExportFileSystemState' 2023-07-15 21:12:34,381 INFO [rs(jenkins-hbase4.apache.org,39075,1689455452043)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.06 KB/3137, heapSize ~6.84 KB/7008, currentSize=0 B/0 for 6ca340acf4d63312d822bf8e2b9da104 in 75ms, sequenceid=6, compaction requested=false 2023-07-15 21:12:34,381 DEBUG [rs(jenkins-hbase4.apache.org,39075,1689455452043)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testEmptyExportFileSystemState' 2023-07-15 21:12:34,384 DEBUG [rs(jenkins-hbase4.apache.org,39587,1689455451998)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for c2ab947ec4d68b6742a54dbdc97c072d: 2023-07-15 21:12:34,384 DEBUG [rs(jenkins-hbase4.apache.org,39075,1689455452043)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 6ca340acf4d63312d822bf8e2b9da104: 2023-07-15 21:12:34,384 DEBUG [rs(jenkins-hbase4.apache.org,39587,1689455451998)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,,1689455552596.c2ab947ec4d68b6742a54dbdc97c072d.' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-15 21:12:34,385 DEBUG [rs(jenkins-hbase4.apache.org,39075,1689455452043)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,1,1689455552596.6ca340acf4d63312d822bf8e2b9da104.' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-15 21:12:34,386 DEBUG [rs(jenkins-hbase4.apache.org,39587,1689455451998)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-15 21:12:34,386 DEBUG [rs(jenkins-hbase4.apache.org,39075,1689455452043)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-15 21:12:34,386 DEBUG [rs(jenkins-hbase4.apache.org,39587,1689455451998)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/data/default/testtb-testEmptyExportFileSystemState/c2ab947ec4d68b6742a54dbdc97c072d/cf/4af0c922fc7d43d6a356fe84c4d5afde] hfiles 2023-07-15 21:12:34,386 DEBUG [rs(jenkins-hbase4.apache.org,39075,1689455452043)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/data/default/testtb-testEmptyExportFileSystemState/6ca340acf4d63312d822bf8e2b9da104/cf/52f54335e68c42febd7a874463e432cd] hfiles 2023-07-15 21:12:34,386 DEBUG [rs(jenkins-hbase4.apache.org,39587,1689455451998)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/data/default/testtb-testEmptyExportFileSystemState/c2ab947ec4d68b6742a54dbdc97c072d/cf/4af0c922fc7d43d6a356fe84c4d5afde for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-15 21:12:34,386 DEBUG [rs(jenkins-hbase4.apache.org,39075,1689455452043)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/data/default/testtb-testEmptyExportFileSystemState/6ca340acf4d63312d822bf8e2b9da104/cf/52f54335e68c42febd7a874463e432cd for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-15 21:12:34,401 DEBUG [rs(jenkins-hbase4.apache.org,39587,1689455451998)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1689455552596.c2ab947ec4d68b6742a54dbdc97c072d. completed. 2023-07-15 21:12:34,401 DEBUG [rs(jenkins-hbase4.apache.org,39587,1689455451998)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,,1689455552596.c2ab947ec4d68b6742a54dbdc97c072d. 2023-07-15 21:12:34,401 DEBUG [member: 'jenkins-hbase4.apache.org,39587,1689455451998' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-15 21:12:34,401 DEBUG [member: 'jenkins-hbase4.apache.org,39587,1689455451998' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-15 21:12:34,401 DEBUG [member: 'jenkins-hbase4.apache.org,39587,1689455451998' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,39587,1689455451998 2023-07-15 21:12:34,401 DEBUG [member: 'jenkins-hbase4.apache.org,39587,1689455451998' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-07-15 21:12:34,401 DEBUG [member: 'jenkins-hbase4.apache.org,39587,1689455451998' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,39587,1689455451998' in zk 2023-07-15 21:12:34,403 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): master:36465-0x1016ad2d8bb0000, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39587,1689455451998 2023-07-15 21:12:34,403 DEBUG [member: 'jenkins-hbase4.apache.org,39587,1689455451998' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-15 21:12:34,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39587,1689455451998 2023-07-15 21:12:34,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 21:12:34,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 21:12:34,403 DEBUG [member: 'jenkins-hbase4.apache.org,39587,1689455451998' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 21:12:34,403 DEBUG [member: 'jenkins-hbase4.apache.org,39587,1689455451998' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-07-15 21:12:34,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 21:12:34,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 21:12:34,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-15 21:12:34,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39075,1689455452043 2023-07-15 21:12:34,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39587,1689455451998 2023-07-15 21:12:34,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37853,1689455451932 2023-07-15 21:12:34,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 21:12:34,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-15 21:12:34,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39587,1689455451998 2023-07-15 21:12:34,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37853,1689455451932 2023-07-15 21:12:34,415 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,39587,1689455451998': 2023-07-15 21:12:34,415 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39587,1689455451998' released barrier for procedure'snaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 1 more 2023-07-15 21:12:34,416 DEBUG [rs(jenkins-hbase4.apache.org,39075,1689455452043)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1689455552596.6ca340acf4d63312d822bf8e2b9da104. completed. 2023-07-15 21:12:34,416 DEBUG [rs(jenkins-hbase4.apache.org,39075,1689455452043)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,1,1689455552596.6ca340acf4d63312d822bf8e2b9da104. 2023-07-15 21:12:34,416 DEBUG [member: 'jenkins-hbase4.apache.org,39075,1689455452043' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-15 21:12:34,416 DEBUG [member: 'jenkins-hbase4.apache.org,39075,1689455452043' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-15 21:12:34,416 DEBUG [member: 'jenkins-hbase4.apache.org,39075,1689455452043' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,39075,1689455452043 2023-07-15 21:12:34,416 DEBUG [member: 'jenkins-hbase4.apache.org,39075,1689455452043' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-07-15 21:12:34,416 DEBUG [member: 'jenkins-hbase4.apache.org,39075,1689455452043' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,39075,1689455452043' in zk 2023-07-15 21:12:34,418 DEBUG [member: 'jenkins-hbase4.apache.org,39075,1689455452043' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-15 21:12:34,418 DEBUG [member: 'jenkins-hbase4.apache.org,39075,1689455452043' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 21:12:34,418 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): master:36465-0x1016ad2d8bb0000, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39075,1689455452043 2023-07-15 21:12:34,418 DEBUG [member: 'jenkins-hbase4.apache.org,39075,1689455452043' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-07-15 21:12:34,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39075,1689455452043 2023-07-15 21:12:34,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 21:12:34,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 21:12:34,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 21:12:34,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 21:12:34,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-15 21:12:34,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39075,1689455452043 2023-07-15 21:12:34,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39587,1689455451998 2023-07-15 21:12:34,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37853,1689455451932 2023-07-15 21:12:34,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 21:12:34,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-15 21:12:34,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39075,1689455452043 2023-07-15 21:12:34,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39587,1689455451998 2023-07-15 21:12:34,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37853,1689455451932 2023-07-15 21:12:34,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,39075,1689455452043': 2023-07-15 21:12:34,424 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39075,1689455452043' released barrier for procedure'snaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 0 more 2023-07-15 21:12:34,424 INFO [(jenkins-hbase4.apache.org,36465,1689455450507)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testEmptyExportFileSystemState' execution completed 2023-07-15 21:12:34,424 DEBUG [(jenkins-hbase4.apache.org,36465,1689455450507)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-15 21:12:34,424 DEBUG [(jenkins-hbase4.apache.org,36465,1689455450507)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-15 21:12:34,424 DEBUG [(jenkins-hbase4.apache.org,36465,1689455450507)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testEmptyExportFileSystemState 2023-07-15 21:12:34,424 INFO [(jenkins-hbase4.apache.org,36465,1689455450507)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testEmptyExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-15 21:12:34,426 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): master:36465-0x1016ad2d8bb0000, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-15 21:12:34,426 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): regionserver:37853-0x1016ad2d8bb0001, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-15 21:12:34,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-15 21:12:34,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 21:12:34,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 21:12:34,426 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-15 21:12:34,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-15 21:12:34,426 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): regionserver:37853-0x1016ad2d8bb0001, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 21:12:34,426 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): regionserver:39075-0x1016ad2d8bb0003, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-15 21:12:34,427 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): regionserver:39075-0x1016ad2d8bb0003, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 21:12:34,427 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-15 21:12:34,427 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-15 21:12:34,427 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 21:12:34,427 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 21:12:34,427 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 21:12:34,427 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 21:12:34,427 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 21:12:34,427 DEBUG [(jenkins-hbase4.apache.org,36465,1689455450507)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36465-0x1016ad2d8bb0000, quorum=127.0.0.1:50024, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39075,1689455452043 2023-07-15 21:12:34,427 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-15 21:12:34,427 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-15 21:12:34,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-15 21:12:34,428 DEBUG [(jenkins-hbase4.apache.org,36465,1689455450507)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36465-0x1016ad2d8bb0000, quorum=127.0.0.1:50024, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39587,1689455451998 2023-07-15 21:12:34,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 21:12:34,428 DEBUG [Listener at jenkins-hbase4.apache.org/41711] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-15 21:12:34,428 DEBUG [(jenkins-hbase4.apache.org,36465,1689455450507)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36465-0x1016ad2d8bb0000, quorum=127.0.0.1:50024, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37853,1689455451932 2023-07-15 21:12:34,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-15 21:12:34,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39075,1689455452043 2023-07-15 21:12:34,430 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36465] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-15 21:12:34,431 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36465] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-15 21:12:34,431 DEBUG [Listener at jenkins-hbase4.apache.org/41711] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-07-15 21:12:34,432 DEBUG [(jenkins-hbase4.apache.org,36465,1689455450507)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36465-0x1016ad2d8bb0000, quorum=127.0.0.1:50024, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39075,1689455452043 2023-07-15 21:12:34,432 DEBUG [(jenkins-hbase4.apache.org,36465,1689455450507)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36465-0x1016ad2d8bb0000, quorum=127.0.0.1:50024, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39587,1689455451998 2023-07-15 21:12:34,433 DEBUG [(jenkins-hbase4.apache.org,36465,1689455450507)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36465-0x1016ad2d8bb0000, quorum=127.0.0.1:50024, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37853,1689455451932 2023-07-15 21:12:34,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39587,1689455451998 2023-07-15 21:12:34,438 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): regionserver:39587-0x1016ad2d8bb0002, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-15 21:12:34,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37853,1689455451932 2023-07-15 21:12:34,438 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-15 21:12:34,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-15 21:12:34,438 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): regionserver:39587-0x1016ad2d8bb0002, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 21:12:34,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 21:12:34,439 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 21:12:34,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 21:12:34,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-15 21:12:34,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-15 21:12:34,441 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): master:36465-0x1016ad2d8bb0000, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37853,1689455451932 2023-07-15 21:12:34,441 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): master:36465-0x1016ad2d8bb0000, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-15 21:12:34,441 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): master:36465-0x1016ad2d8bb0000, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39587,1689455451998 2023-07-15 21:12:34,441 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): master:36465-0x1016ad2d8bb0000, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39075,1689455452043 2023-07-15 21:12:34,441 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): master:36465-0x1016ad2d8bb0000, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-15 21:12:34,441 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): regionserver:39587-0x1016ad2d8bb0002, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 21:12:34,441 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): regionserver:37853-0x1016ad2d8bb0001, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 21:12:34,441 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): master:36465-0x1016ad2d8bb0000, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37853,1689455451932 2023-07-15 21:12:34,441 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 21:12:34,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 21:12:34,441 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): regionserver:37853-0x1016ad2d8bb0001, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 21:12:34,441 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): regionserver:39587-0x1016ad2d8bb0002, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 21:12:34,441 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): master:36465-0x1016ad2d8bb0000, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-15 21:12:34,441 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): master:36465-0x1016ad2d8bb0000, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39587,1689455451998 2023-07-15 21:12:34,441 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): master:36465-0x1016ad2d8bb0000, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39075,1689455452043 2023-07-15 21:12:34,441 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): master:36465-0x1016ad2d8bb0000, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-15 21:12:34,441 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): master:36465-0x1016ad2d8bb0000, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-15 21:12:34,442 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): regionserver:39587-0x1016ad2d8bb0002, quorum=127.0.0.1:50024, baseZNode=/hbase Unable to get data of znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState because node does not exist (not an error) 2023-07-15 21:12:34,442 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 21:12:34,442 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 21:12:34,442 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 21:12:34,442 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testEmptyExportFileSystemState 2023-07-15 21:12:34,442 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 21:12:34,442 DEBUG [(jenkins-hbase4.apache.org,36465,1689455450507)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 21:12:34,442 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testEmptyExportFileSystemState 2023-07-15 21:12:34,444 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 37e3865d2ff7e5e2da33a03e3f723df0, NAME => 'testtb-testEmptyExportFileSystemState,.mob,0.37e3865d2ff7e5e2da33a03e3f723df0.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-15 21:12:34,444 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 21:12:34,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 21:12:34,444 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-15 21:12:34,444 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): regionserver:39075-0x1016ad2d8bb0003, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 21:12:34,444 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): regionserver:39075-0x1016ad2d8bb0003, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 21:12:34,444 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 21:12:34,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 21:12:34,445 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:36465-0x1016ad2d8bb0000, quorum=127.0.0.1:50024, baseZNode=/hbase Unable to get data of znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState because node does not exist (not an error) 2023-07-15 21:12:34,445 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 21:12:34,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 21:12:34,445 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b202307151fb1911ad5174952bf23ff9316e977a8, hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e20230715100d3c0b5ab24170966349007a1b4227] mob files 2023-07-15 21:12:34,445 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b202307151fb1911ad5174952bf23ff9316e977a8 2023-07-15 21:12:34,445 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e20230715100d3c0b5ab24170966349007a1b4227 2023-07-15 21:12:34,465 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testEmptyExportFileSystemState 2023-07-15 21:12:34,466 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-07-15 21:12:34,519 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState to hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/.hbase-snapshot/snaptb0-testEmptyExportFileSystemState 2023-07-15 21:12:34,555 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed 2023-07-15 21:12:34,555 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-07-15 21:12:34,556 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-07-15 21:12:34,556 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState at 1689455553823Completed referencing HFiles for the mob region of table: testtb-testEmptyExportFileSystemState at 1689455554465 (+642 ms)Consolidate snapshot: snaptb0-testEmptyExportFileSystemState at 1689455554465Loading Region manifests for snaptb0-testEmptyExportFileSystemState at 1689455554466 (+1 ms)Writing data manifest for snaptb0-testEmptyExportFileSystemState at 1689455554474 (+8 ms)Verifying snapshot: snaptb0-testEmptyExportFileSystemState at 1689455554504 (+30 ms)Snapshot snaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed at 1689455554555 (+51 ms) 2023-07-15 21:12:34,563 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=98, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-15 21:12:34,565 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=98, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED in 729 msec 2023-07-15 21:12:34,932 DEBUG [Listener at jenkins-hbase4.apache.org/41711] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-15 21:12:34,933 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36465] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-15 21:12:34,933 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36465] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-15 21:12:34,933 INFO [Listener at jenkins-hbase4.apache.org/41711] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/export-test/export-1689455554933 2023-07-15 21:12:34,934 INFO [Listener at jenkins-hbase4.apache.org/41711] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:46859, tgtDir=hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/export-test/export-1689455554933, rawTgtDir=hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/export-test/export-1689455554933, srcFsUri=hdfs://localhost:46859, srcDir=hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313 2023-07-15 21:12:34,969 DEBUG [Listener at jenkins-hbase4.apache.org/41711] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:46859, inputRoot=hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313 2023-07-15 21:12:34,969 DEBUG [Listener at jenkins-hbase4.apache.org/41711] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-157561908_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/export-test/export-1689455554933, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/export-test/export-1689455554933/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 21:12:34,970 INFO [Listener at jenkins-hbase4.apache.org/41711] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:46859, inputRoot=hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313, snapshotDir=hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState. 2023-07-15 21:12:35,004 INFO [Listener at jenkins-hbase4.apache.org/41711] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState to hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/export-test/export-1689455554933/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 21:12:35,089 DEBUG [Listener at jenkins-hbase4.apache.org/41711] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-15 21:12:35,090 DEBUG [Listener at jenkins-hbase4.apache.org/41711] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-15 21:12:35,090 DEBUG [Listener at jenkins-hbase4.apache.org/41711] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-15 21:12:35,091 DEBUG [Listener at jenkins-hbase4.apache.org/41711] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-15 21:12:35,091 DEBUG [Listener at jenkins-hbase4.apache.org/41711] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-15 21:12:35,091 DEBUG [Listener at jenkins-hbase4.apache.org/41711] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-15 21:12:35,091 DEBUG [Listener at jenkins-hbase4.apache.org/41711] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-15 21:12:35,185 DEBUG [Listener at jenkins-hbase4.apache.org/41711] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/de3e87f0-08fc-c0d0-c969-4c410fd4e6fd/hadoop-7308260169783438369.jar 2023-07-15 21:12:35,186 DEBUG [Listener at jenkins-hbase4.apache.org/41711] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-15 21:12:35,187 DEBUG [Listener at jenkins-hbase4.apache.org/41711] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-15 21:12:35,187 DEBUG [Listener at jenkins-hbase4.apache.org/41711] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-15 21:12:35,188 DEBUG [Listener at jenkins-hbase4.apache.org/41711] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-15 21:12:35,188 DEBUG [Listener at jenkins-hbase4.apache.org/41711] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-15 21:12:35,189 DEBUG [Listener at jenkins-hbase4.apache.org/41711] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-15 21:12:35,189 DEBUG [Listener at jenkins-hbase4.apache.org/41711] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-15 21:12:35,190 DEBUG [Listener at jenkins-hbase4.apache.org/41711] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-15 21:12:35,190 DEBUG [Listener at jenkins-hbase4.apache.org/41711] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-15 21:12:35,191 DEBUG [Listener at jenkins-hbase4.apache.org/41711] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-15 21:12:35,191 DEBUG [Listener at jenkins-hbase4.apache.org/41711] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-15 21:12:35,192 DEBUG [Listener at jenkins-hbase4.apache.org/41711] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-15 21:12:35,201 DEBUG [Listener at jenkins-hbase4.apache.org/41711] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-15 21:12:35,202 DEBUG [Listener at jenkins-hbase4.apache.org/41711] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-15 21:12:35,203 DEBUG [Listener at jenkins-hbase4.apache.org/41711] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-15 21:12:35,203 DEBUG [Listener at jenkins-hbase4.apache.org/41711] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-15 21:12:35,204 DEBUG [Listener at jenkins-hbase4.apache.org/41711] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-15 21:12:35,204 DEBUG [Listener at jenkins-hbase4.apache.org/41711] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-15 21:12:35,205 DEBUG [Listener at jenkins-hbase4.apache.org/41711] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-15 21:12:35,205 DEBUG [Listener at jenkins-hbase4.apache.org/41711] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-15 21:12:35,206 DEBUG [Listener at jenkins-hbase4.apache.org/41711] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-15 21:12:35,206 DEBUG [Listener at jenkins-hbase4.apache.org/41711] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-15 21:12:35,207 DEBUG [Listener at jenkins-hbase4.apache.org/41711] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-15 21:12:36,302 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689455459463_0005_000001 (auth:SIMPLE) 2023-07-15 21:12:36,442 WARN [Listener at jenkins-hbase4.apache.org/41711] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-15 21:12:36,447 INFO [Listener at jenkins-hbase4.apache.org/41711] snapshot.ExportSnapshot(578): Loading Snapshot 'emptySnaptb0-testEmptyExportFileSystemState' hfile list 2023-07-15 21:12:36,578 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-15 21:12:36,578 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-15 21:12:37,312 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689455459463_0006_000001 (auth:SIMPLE) 2023-07-15 21:12:37,473 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-15 21:12:43,515 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689455459463_0006_000001 (auth:SIMPLE) 2023-07-15 21:12:45,918 INFO [Listener at jenkins-hbase4.apache.org/41711] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-15 21:12:45,918 INFO [Listener at jenkins-hbase4.apache.org/41711] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-15 21:12:45,965 INFO [Listener at jenkins-hbase4.apache.org/41711] snapshot.ExportSnapshot(1127): Export Completed: emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 21:12:45,965 INFO [Listener at jenkins-hbase4.apache.org/41711] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-15 21:12:45,967 INFO [Listener at jenkins-hbase4.apache.org/41711] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-15 21:12:45,967 DEBUG [Listener at jenkins-hbase4.apache.org/41711] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1600112846_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState at hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 21:12:45,968 DEBUG [Listener at jenkins-hbase4.apache.org/41711] snapshot.TestExportSnapshot(367): hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/.snapshotinfo 2023-07-15 21:12:45,968 DEBUG [Listener at jenkins-hbase4.apache.org/41711] snapshot.TestExportSnapshot(367): hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/data.manifest 2023-07-15 21:12:45,968 DEBUG [Listener at jenkins-hbase4.apache.org/41711] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1600112846_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/export-test/export-1689455554933/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState at hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/export-test/export-1689455554933/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 21:12:45,969 DEBUG [Listener at jenkins-hbase4.apache.org/41711] snapshot.TestExportSnapshot(367): hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/export-test/export-1689455554933/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/.snapshotinfo 2023-07-15 21:12:45,969 DEBUG [Listener at jenkins-hbase4.apache.org/41711] snapshot.TestExportSnapshot(367): hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/export-test/export-1689455554933/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/data.manifest 2023-07-15 21:12:45,984 INFO [Listener at jenkins-hbase4.apache.org/41711] client.HBaseAdmin$15(890): Started disable of testtb-testEmptyExportFileSystemState 2023-07-15 21:12:45,985 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36465] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testEmptyExportFileSystemState 2023-07-15 21:12:45,986 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36465] procedure2.ProcedureExecutor(1029): Stored pid=99, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-15 21:12:45,991 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689455565990"}]},"ts":"1689455565990"} 2023-07-15 21:12:45,991 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36465] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-07-15 21:12:45,994 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=DISABLING in hbase:meta 2023-07-15 21:12:45,998 INFO [PEWorker-4] procedure.DisableTableProcedure(293): Set testtb-testEmptyExportFileSystemState to state=DISABLING 2023-07-15 21:12:46,000 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=100, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=c2ab947ec4d68b6742a54dbdc97c072d, UNASSIGN}, {pid=101, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=6ca340acf4d63312d822bf8e2b9da104, UNASSIGN}] 2023-07-15 21:12:46,003 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=100, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=c2ab947ec4d68b6742a54dbdc97c072d, UNASSIGN 2023-07-15 21:12:46,003 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=101, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=6ca340acf4d63312d822bf8e2b9da104, UNASSIGN 2023-07-15 21:12:46,004 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=101 updating hbase:meta row=6ca340acf4d63312d822bf8e2b9da104, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,39075,1689455452043 2023-07-15 21:12:46,004 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=c2ab947ec4d68b6742a54dbdc97c072d, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,39587,1689455451998 2023-07-15 21:12:46,004 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,1,1689455552596.6ca340acf4d63312d822bf8e2b9da104.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689455566004"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689455566004"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689455566004"}]},"ts":"1689455566004"} 2023-07-15 21:12:46,004 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,,1689455552596.c2ab947ec4d68b6742a54dbdc97c072d.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689455566004"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689455566004"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689455566004"}]},"ts":"1689455566004"} 2023-07-15 21:12:46,006 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=102, ppid=101, state=RUNNABLE; CloseRegionProcedure 6ca340acf4d63312d822bf8e2b9da104, server=jenkins-hbase4.apache.org,39075,1689455452043}] 2023-07-15 21:12:46,007 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=103, ppid=100, state=RUNNABLE; CloseRegionProcedure c2ab947ec4d68b6742a54dbdc97c072d, server=jenkins-hbase4.apache.org,39587,1689455451998}] 2023-07-15 21:12:46,093 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36465] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-07-15 21:12:46,159 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 6ca340acf4d63312d822bf8e2b9da104 2023-07-15 21:12:46,159 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 6ca340acf4d63312d822bf8e2b9da104, disabling compactions & flushes 2023-07-15 21:12:46,160 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,1,1689455552596.6ca340acf4d63312d822bf8e2b9da104. 2023-07-15 21:12:46,160 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,1,1689455552596.6ca340acf4d63312d822bf8e2b9da104. 2023-07-15 21:12:46,160 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,1,1689455552596.6ca340acf4d63312d822bf8e2b9da104. after waiting 0 ms 2023-07-15 21:12:46,160 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,1,1689455552596.6ca340acf4d63312d822bf8e2b9da104. 2023-07-15 21:12:46,160 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close c2ab947ec4d68b6742a54dbdc97c072d 2023-07-15 21:12:46,160 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing c2ab947ec4d68b6742a54dbdc97c072d, disabling compactions & flushes 2023-07-15 21:12:46,160 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,,1689455552596.c2ab947ec4d68b6742a54dbdc97c072d. 2023-07-15 21:12:46,160 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,,1689455552596.c2ab947ec4d68b6742a54dbdc97c072d. 2023-07-15 21:12:46,160 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,,1689455552596.c2ab947ec4d68b6742a54dbdc97c072d. after waiting 0 ms 2023-07-15 21:12:46,160 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,,1689455552596.c2ab947ec4d68b6742a54dbdc97c072d. 2023-07-15 21:12:46,210 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/data/default/testtb-testEmptyExportFileSystemState/c2ab947ec4d68b6742a54dbdc97c072d/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-15 21:12:46,211 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/data/default/testtb-testEmptyExportFileSystemState/6ca340acf4d63312d822bf8e2b9da104/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-15 21:12:46,211 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-15 21:12:46,212 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,,1689455552596.c2ab947ec4d68b6742a54dbdc97c072d. 2023-07-15 21:12:46,213 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for c2ab947ec4d68b6742a54dbdc97c072d: 2023-07-15 21:12:46,213 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-15 21:12:46,214 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,1,1689455552596.6ca340acf4d63312d822bf8e2b9da104. 2023-07-15 21:12:46,214 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 6ca340acf4d63312d822bf8e2b9da104: 2023-07-15 21:12:46,215 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed c2ab947ec4d68b6742a54dbdc97c072d 2023-07-15 21:12:46,216 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=c2ab947ec4d68b6742a54dbdc97c072d, regionState=CLOSED 2023-07-15 21:12:46,216 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,,1689455552596.c2ab947ec4d68b6742a54dbdc97c072d.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689455566216"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689455566216"}]},"ts":"1689455566216"} 2023-07-15 21:12:46,216 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 6ca340acf4d63312d822bf8e2b9da104 2023-07-15 21:12:46,221 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=101 updating hbase:meta row=6ca340acf4d63312d822bf8e2b9da104, regionState=CLOSED 2023-07-15 21:12:46,222 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,1,1689455552596.6ca340acf4d63312d822bf8e2b9da104.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689455566221"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689455566221"}]},"ts":"1689455566221"} 2023-07-15 21:12:46,224 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=103, resume processing ppid=100 2023-07-15 21:12:46,224 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=103, ppid=100, state=SUCCESS; CloseRegionProcedure c2ab947ec4d68b6742a54dbdc97c072d, server=jenkins-hbase4.apache.org,39587,1689455451998 in 215 msec 2023-07-15 21:12:46,225 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=102, resume processing ppid=101 2023-07-15 21:12:46,225 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=100, ppid=99, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=c2ab947ec4d68b6742a54dbdc97c072d, UNASSIGN in 224 msec 2023-07-15 21:12:46,225 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=102, ppid=101, state=SUCCESS; CloseRegionProcedure 6ca340acf4d63312d822bf8e2b9da104, server=jenkins-hbase4.apache.org,39075,1689455452043 in 217 msec 2023-07-15 21:12:46,227 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=101, resume processing ppid=99 2023-07-15 21:12:46,227 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=101, ppid=99, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=6ca340acf4d63312d822bf8e2b9da104, UNASSIGN in 225 msec 2023-07-15 21:12:46,227 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689455566227"}]},"ts":"1689455566227"} 2023-07-15 21:12:46,228 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=DISABLED in hbase:meta 2023-07-15 21:12:46,230 INFO [PEWorker-4] procedure.DisableTableProcedure(305): Set testtb-testEmptyExportFileSystemState to state=DISABLED 2023-07-15 21:12:46,231 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=99, state=SUCCESS; DisableTableProcedure table=testtb-testEmptyExportFileSystemState in 245 msec 2023-07-15 21:12:46,296 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36465] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-07-15 21:12:46,297 INFO [Listener at jenkins-hbase4.apache.org/41711] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 99 completed 2023-07-15 21:12:46,298 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36465] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testEmptyExportFileSystemState 2023-07-15 21:12:46,299 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36465] procedure2.ProcedureExecutor(1029): Stored pid=104, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-15 21:12:46,302 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=104, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-15 21:12:46,302 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36465] access.PermissionStorage(259): Removing permissions of removed table testtb-testEmptyExportFileSystemState 2023-07-15 21:12:46,302 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=104, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-15 21:12:46,304 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=39075] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testEmptyExportFileSystemState 2023-07-15 21:12:46,308 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/.tmp/data/default/testtb-testEmptyExportFileSystemState/6ca340acf4d63312d822bf8e2b9da104 2023-07-15 21:12:46,308 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): regionserver:39587-0x1016ad2d8bb0002, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-15 21:12:46,308 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): master:36465-0x1016ad2d8bb0000, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-15 21:12:46,308 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): regionserver:37853-0x1016ad2d8bb0001, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-15 21:12:46,308 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): regionserver:39075-0x1016ad2d8bb0003, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-15 21:12:46,308 DEBUG [HFileArchiver-21] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/.tmp/data/default/testtb-testEmptyExportFileSystemState/c2ab947ec4d68b6742a54dbdc97c072d 2023-07-15 21:12:46,310 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-07-15 21:12:46,310 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-07-15 21:12:46,310 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-07-15 21:12:46,311 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-07-15 21:12:46,312 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): regionserver:37853-0x1016ad2d8bb0001, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-15 21:12:46,312 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): regionserver:39075-0x1016ad2d8bb0003, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-15 21:12:46,312 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): regionserver:39075-0x1016ad2d8bb0003, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 21:12:46,312 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): master:36465-0x1016ad2d8bb0000, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-15 21:12:46,312 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): regionserver:37853-0x1016ad2d8bb0001, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 21:12:46,312 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): regionserver:39587-0x1016ad2d8bb0002, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-15 21:12:46,312 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): regionserver:39587-0x1016ad2d8bb0002, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 21:12:46,312 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): master:36465-0x1016ad2d8bb0000, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 21:12:46,313 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/.tmp/data/default/testtb-testEmptyExportFileSystemState/6ca340acf4d63312d822bf8e2b9da104/cf, FileablePath, hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/.tmp/data/default/testtb-testEmptyExportFileSystemState/6ca340acf4d63312d822bf8e2b9da104/recovered.edits] 2023-07-15 21:12:46,314 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36465] master.MasterRpcServices(1230): Checking to see if procedure is done pid=104 2023-07-15 21:12:46,316 DEBUG [HFileArchiver-21] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/.tmp/data/default/testtb-testEmptyExportFileSystemState/c2ab947ec4d68b6742a54dbdc97c072d/cf, FileablePath, hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/.tmp/data/default/testtb-testEmptyExportFileSystemState/c2ab947ec4d68b6742a54dbdc97c072d/recovered.edits] 2023-07-15 21:12:46,325 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/.tmp/data/default/testtb-testEmptyExportFileSystemState/6ca340acf4d63312d822bf8e2b9da104/cf/52f54335e68c42febd7a874463e432cd to hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/archive/data/default/testtb-testEmptyExportFileSystemState/6ca340acf4d63312d822bf8e2b9da104/cf/52f54335e68c42febd7a874463e432cd 2023-07-15 21:12:46,327 DEBUG [HFileArchiver-21] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/.tmp/data/default/testtb-testEmptyExportFileSystemState/c2ab947ec4d68b6742a54dbdc97c072d/cf/4af0c922fc7d43d6a356fe84c4d5afde to hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/archive/data/default/testtb-testEmptyExportFileSystemState/c2ab947ec4d68b6742a54dbdc97c072d/cf/4af0c922fc7d43d6a356fe84c4d5afde 2023-07-15 21:12:46,330 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/.tmp/data/default/testtb-testEmptyExportFileSystemState/6ca340acf4d63312d822bf8e2b9da104/recovered.edits/9.seqid to hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/archive/data/default/testtb-testEmptyExportFileSystemState/6ca340acf4d63312d822bf8e2b9da104/recovered.edits/9.seqid 2023-07-15 21:12:46,330 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/.tmp/data/default/testtb-testEmptyExportFileSystemState/6ca340acf4d63312d822bf8e2b9da104 2023-07-15 21:12:46,331 DEBUG [HFileArchiver-21] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/.tmp/data/default/testtb-testEmptyExportFileSystemState/c2ab947ec4d68b6742a54dbdc97c072d/recovered.edits/9.seqid to hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/archive/data/default/testtb-testEmptyExportFileSystemState/c2ab947ec4d68b6742a54dbdc97c072d/recovered.edits/9.seqid 2023-07-15 21:12:46,334 DEBUG [HFileArchiver-21] backup.HFileArchiver(596): Deleted hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/.tmp/data/default/testtb-testEmptyExportFileSystemState/c2ab947ec4d68b6742a54dbdc97c072d 2023-07-15 21:12:46,334 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testEmptyExportFileSystemState regions 2023-07-15 21:12:46,335 DEBUG [PEWorker-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0 2023-07-15 21:12:46,336 DEBUG [PEWorker-2] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf] 2023-07-15 21:12:46,342 DEBUG [PEWorker-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b202307151fb1911ad5174952bf23ff9316e977a8 to hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/archive/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b202307151fb1911ad5174952bf23ff9316e977a8 2023-07-15 21:12:46,343 DEBUG [PEWorker-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e20230715100d3c0b5ab24170966349007a1b4227 to hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/archive/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e20230715100d3c0b5ab24170966349007a1b4227 2023-07-15 21:12:46,344 DEBUG [PEWorker-2] backup.HFileArchiver(596): Deleted hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0 2023-07-15 21:12:46,346 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=104, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-15 21:12:46,348 WARN [PEWorker-2] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testEmptyExportFileSystemState from hbase:meta 2023-07-15 21:12:46,351 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(421): Removing 'testtb-testEmptyExportFileSystemState' descriptor. 2023-07-15 21:12:46,352 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=104, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-15 21:12:46,352 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(411): Removing 'testtb-testEmptyExportFileSystemState' from region states. 2023-07-15 21:12:46,352 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState,,1689455552596.c2ab947ec4d68b6742a54dbdc97c072d.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689455566352"}]},"ts":"9223372036854775807"} 2023-07-15 21:12:46,352 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState,1,1689455552596.6ca340acf4d63312d822bf8e2b9da104.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689455566352"}]},"ts":"9223372036854775807"} 2023-07-15 21:12:46,359 INFO [PEWorker-2] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-15 21:12:46,359 DEBUG [PEWorker-2] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => c2ab947ec4d68b6742a54dbdc97c072d, NAME => 'testtb-testEmptyExportFileSystemState,,1689455552596.c2ab947ec4d68b6742a54dbdc97c072d.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 6ca340acf4d63312d822bf8e2b9da104, NAME => 'testtb-testEmptyExportFileSystemState,1,1689455552596.6ca340acf4d63312d822bf8e2b9da104.', STARTKEY => '1', ENDKEY => ''}] 2023-07-15 21:12:46,359 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(415): Marking 'testtb-testEmptyExportFileSystemState' as deleted. 2023-07-15 21:12:46,359 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689455566359"}]},"ts":"9223372036854775807"} 2023-07-15 21:12:46,362 INFO [PEWorker-2] hbase.MetaTableAccessor(1658): Deleted table testtb-testEmptyExportFileSystemState state from META 2023-07-15 21:12:46,365 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(130): Finished pid=104, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-15 21:12:46,366 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=104, state=SUCCESS; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState in 67 msec 2023-07-15 21:12:46,416 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36465] master.MasterRpcServices(1230): Checking to see if procedure is done pid=104 2023-07-15 21:12:46,418 INFO [Listener at jenkins-hbase4.apache.org/41711] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 104 completed 2023-07-15 21:12:46,427 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36465] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testEmptyExportFileSystemState" 2023-07-15 21:12:46,429 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36465] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 21:12:46,431 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36465] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testEmptyExportFileSystemState" 2023-07-15 21:12:46,434 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36465] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testEmptyExportFileSystemState 2023-07-15 21:12:46,488 INFO [Listener at jenkins-hbase4.apache.org/41711] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testEmptyExportFileSystemState Thread=761 (was 758) Potentially hanging thread: hconnection-0x401a2f8d-shared-pool-37 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (2038956992) connection to jenkins-hbase4.apache.org/172.31.14.131:34873 from appattempt_1689455459463_0006_000001 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: ApplicationMasterLauncher #9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x401a2f8d-shared-pool-36 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (2038956992) connection to jenkins-hbase4.apache.org/172.31.14.131:40535 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1600112846_17 at /127.0.0.1:41326 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x401a2f8d-shared-pool-34 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-189931907_1 at /127.0.0.1:41316 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-4909 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: HFileArchiver-21 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x401a2f8d-shared-pool-35 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1600112846_17 at /127.0.0.1:37766 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LogDeleter #3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1088) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-189931907_1 at /127.0.0.1:37738 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1600112846_17 at /127.0.0.1:44118 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=921 (was 903) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=550 (was 486) - SystemLoadAverage LEAK? -, ProcessCount=182 (was 182), AvailableMemoryMB=1895 (was 2175) 2023-07-15 21:12:46,488 WARN [Listener at jenkins-hbase4.apache.org/41711] hbase.ResourceChecker(130): Thread=761 is superior to 500 2023-07-15 21:12:46,523 INFO [Listener at jenkins-hbase4.apache.org/41711] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithSkipTmp Thread=761, OpenFileDescriptor=921, MaxFileDescriptor=60000, SystemLoadAverage=550, ProcessCount=182, AvailableMemoryMB=1893 2023-07-15 21:12:46,523 WARN [Listener at jenkins-hbase4.apache.org/41711] hbase.ResourceChecker(130): Thread=761 is superior to 500 2023-07-15 21:12:46,525 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36465] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-07-15 21:12:46,526 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36465] procedure2.ProcedureExecutor(1029): Stored pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-15 21:12:46,529 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_PRE_OPERATION 2023-07-15 21:12:46,529 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36465] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithSkipTmp" procId is: 105 2023-07-15 21:12:46,530 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-15 21:12:46,530 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36465] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-15 21:12:46,532 DEBUG [HFileArchiver-20] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/106264d98f4159c78cc8f13df7eabf30 2023-07-15 21:12:46,532 DEBUG [HFileArchiver-19] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/adb292f49877fba2e1d2c5f9b3cec3ec 2023-07-15 21:12:46,533 DEBUG [HFileArchiver-20] backup.HFileArchiver(153): Directory hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/106264d98f4159c78cc8f13df7eabf30 empty. 2023-07-15 21:12:46,533 DEBUG [HFileArchiver-19] backup.HFileArchiver(153): Directory hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/adb292f49877fba2e1d2c5f9b3cec3ec empty. 2023-07-15 21:12:46,533 DEBUG [HFileArchiver-20] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/106264d98f4159c78cc8f13df7eabf30 2023-07-15 21:12:46,534 DEBUG [HFileArchiver-19] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/adb292f49877fba2e1d2c5f9b3cec3ec 2023-07-15 21:12:46,534 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithSkipTmp regions 2023-07-15 21:12:46,579 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/.tabledesc/.tableinfo.0000000001 2023-07-15 21:12:46,584 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(7675): creating {ENCODED => adb292f49877fba2e1d2c5f9b3cec3ec, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1689455566525.adb292f49877fba2e1d2c5f9b3cec3ec.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/.tmp 2023-07-15 21:12:46,584 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(7675): creating {ENCODED => 106264d98f4159c78cc8f13df7eabf30, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1689455566525.106264d98f4159c78cc8f13df7eabf30.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/.tmp 2023-07-15 21:12:46,631 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36465] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-15 21:12:46,664 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,,1689455566525.106264d98f4159c78cc8f13df7eabf30.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-15 21:12:46,668 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1604): Closing 106264d98f4159c78cc8f13df7eabf30, disabling compactions & flushes 2023-07-15 21:12:46,668 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,,1689455566525.106264d98f4159c78cc8f13df7eabf30. 2023-07-15 21:12:46,668 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,,1689455566525.106264d98f4159c78cc8f13df7eabf30. 2023-07-15 21:12:46,668 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,,1689455566525.106264d98f4159c78cc8f13df7eabf30. after waiting 0 ms 2023-07-15 21:12:46,668 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,,1689455566525.106264d98f4159c78cc8f13df7eabf30. 2023-07-15 21:12:46,668 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,,1689455566525.106264d98f4159c78cc8f13df7eabf30. 2023-07-15 21:12:46,668 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1558): Region close journal for 106264d98f4159c78cc8f13df7eabf30: 2023-07-15 21:12:46,703 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,1,1689455566525.adb292f49877fba2e1d2c5f9b3cec3ec.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-15 21:12:46,703 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1604): Closing adb292f49877fba2e1d2c5f9b3cec3ec, disabling compactions & flushes 2023-07-15 21:12:46,703 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,1,1689455566525.adb292f49877fba2e1d2c5f9b3cec3ec. 2023-07-15 21:12:46,703 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1689455566525.adb292f49877fba2e1d2c5f9b3cec3ec. 2023-07-15 21:12:46,703 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1689455566525.adb292f49877fba2e1d2c5f9b3cec3ec. after waiting 0 ms 2023-07-15 21:12:46,703 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,1,1689455566525.adb292f49877fba2e1d2c5f9b3cec3ec. 2023-07-15 21:12:46,703 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,1,1689455566525.adb292f49877fba2e1d2c5f9b3cec3ec. 2023-07-15 21:12:46,703 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1558): Region close journal for adb292f49877fba2e1d2c5f9b3cec3ec: 2023-07-15 21:12:46,709 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_ADD_TO_META 2023-07-15 21:12:46,710 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689455566525.106264d98f4159c78cc8f13df7eabf30.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689455566710"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689455566710"}]},"ts":"1689455566710"} 2023-07-15 21:12:46,710 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689455566525.adb292f49877fba2e1d2c5f9b3cec3ec.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689455566710"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689455566710"}]},"ts":"1689455566710"} 2023-07-15 21:12:46,714 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-15 21:12:46,715 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-15 21:12:46,715 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689455566715"}]},"ts":"1689455566715"} 2023-07-15 21:12:46,717 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=ENABLING in hbase:meta 2023-07-15 21:12:46,721 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-15 21:12:46,723 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-15 21:12:46,723 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-15 21:12:46,723 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-15 21:12:46,723 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-15 21:12:46,723 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=106264d98f4159c78cc8f13df7eabf30, ASSIGN}, {pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=adb292f49877fba2e1d2c5f9b3cec3ec, ASSIGN}] 2023-07-15 21:12:46,727 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=106264d98f4159c78cc8f13df7eabf30, ASSIGN 2023-07-15 21:12:46,727 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=adb292f49877fba2e1d2c5f9b3cec3ec, ASSIGN 2023-07-15 21:12:46,729 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=106264d98f4159c78cc8f13df7eabf30, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,39075,1689455452043; forceNewPlan=false, retain=false 2023-07-15 21:12:46,729 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=adb292f49877fba2e1d2c5f9b3cec3ec, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,39587,1689455451998; forceNewPlan=false, retain=false 2023-07-15 21:12:46,833 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36465] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-15 21:12:46,879 INFO [jenkins-hbase4:36465] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-15 21:12:46,883 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=106264d98f4159c78cc8f13df7eabf30, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,39075,1689455452043 2023-07-15 21:12:46,883 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=adb292f49877fba2e1d2c5f9b3cec3ec, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,39587,1689455451998 2023-07-15 21:12:46,883 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689455566525.106264d98f4159c78cc8f13df7eabf30.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689455566883"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689455566883"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689455566883"}]},"ts":"1689455566883"} 2023-07-15 21:12:46,883 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689455566525.adb292f49877fba2e1d2c5f9b3cec3ec.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689455566883"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689455566883"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689455566883"}]},"ts":"1689455566883"} 2023-07-15 21:12:46,885 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=108, ppid=106, state=RUNNABLE; OpenRegionProcedure 106264d98f4159c78cc8f13df7eabf30, server=jenkins-hbase4.apache.org,39075,1689455452043}] 2023-07-15 21:12:46,887 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=109, ppid=107, state=RUNNABLE; OpenRegionProcedure adb292f49877fba2e1d2c5f9b3cec3ec, server=jenkins-hbase4.apache.org,39587,1689455451998}] 2023-07-15 21:12:47,043 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithSkipTmp,,1689455566525.106264d98f4159c78cc8f13df7eabf30. 2023-07-15 21:12:47,043 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 106264d98f4159c78cc8f13df7eabf30, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1689455566525.106264d98f4159c78cc8f13df7eabf30.', STARTKEY => '', ENDKEY => '1'} 2023-07-15 21:12:47,043 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithSkipTmp,,1689455566525.106264d98f4159c78cc8f13df7eabf30. service=AccessControlService 2023-07-15 21:12:47,043 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-15 21:12:47,043 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithSkipTmp 106264d98f4159c78cc8f13df7eabf30 2023-07-15 21:12:47,043 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,,1689455566525.106264d98f4159c78cc8f13df7eabf30.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-15 21:12:47,044 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 106264d98f4159c78cc8f13df7eabf30 2023-07-15 21:12:47,044 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 106264d98f4159c78cc8f13df7eabf30 2023-07-15 21:12:47,044 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithSkipTmp,1,1689455566525.adb292f49877fba2e1d2c5f9b3cec3ec. 2023-07-15 21:12:47,044 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => adb292f49877fba2e1d2c5f9b3cec3ec, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1689455566525.adb292f49877fba2e1d2c5f9b3cec3ec.', STARTKEY => '1', ENDKEY => ''} 2023-07-15 21:12:47,044 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithSkipTmp,1,1689455566525.adb292f49877fba2e1d2c5f9b3cec3ec. service=AccessControlService 2023-07-15 21:12:47,044 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-15 21:12:47,044 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithSkipTmp adb292f49877fba2e1d2c5f9b3cec3ec 2023-07-15 21:12:47,044 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,1,1689455566525.adb292f49877fba2e1d2c5f9b3cec3ec.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-15 21:12:47,045 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for adb292f49877fba2e1d2c5f9b3cec3ec 2023-07-15 21:12:47,045 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for adb292f49877fba2e1d2c5f9b3cec3ec 2023-07-15 21:12:47,046 INFO [StoreOpener-adb292f49877fba2e1d2c5f9b3cec3ec-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region adb292f49877fba2e1d2c5f9b3cec3ec 2023-07-15 21:12:47,047 INFO [StoreOpener-106264d98f4159c78cc8f13df7eabf30-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 106264d98f4159c78cc8f13df7eabf30 2023-07-15 21:12:47,048 DEBUG [StoreOpener-106264d98f4159c78cc8f13df7eabf30-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/data/default/testtb-testExportFileSystemStateWithSkipTmp/106264d98f4159c78cc8f13df7eabf30/cf 2023-07-15 21:12:47,048 DEBUG [StoreOpener-106264d98f4159c78cc8f13df7eabf30-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/data/default/testtb-testExportFileSystemStateWithSkipTmp/106264d98f4159c78cc8f13df7eabf30/cf 2023-07-15 21:12:47,049 INFO [StoreOpener-106264d98f4159c78cc8f13df7eabf30-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 106264d98f4159c78cc8f13df7eabf30 columnFamilyName cf 2023-07-15 21:12:47,049 DEBUG [StoreOpener-adb292f49877fba2e1d2c5f9b3cec3ec-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/data/default/testtb-testExportFileSystemStateWithSkipTmp/adb292f49877fba2e1d2c5f9b3cec3ec/cf 2023-07-15 21:12:47,049 DEBUG [StoreOpener-adb292f49877fba2e1d2c5f9b3cec3ec-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/data/default/testtb-testExportFileSystemStateWithSkipTmp/adb292f49877fba2e1d2c5f9b3cec3ec/cf 2023-07-15 21:12:47,049 INFO [StoreOpener-adb292f49877fba2e1d2c5f9b3cec3ec-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region adb292f49877fba2e1d2c5f9b3cec3ec columnFamilyName cf 2023-07-15 21:12:47,050 INFO [StoreOpener-adb292f49877fba2e1d2c5f9b3cec3ec-1] regionserver.HStore(310): Store=adb292f49877fba2e1d2c5f9b3cec3ec/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-15 21:12:47,051 INFO [StoreOpener-106264d98f4159c78cc8f13df7eabf30-1] regionserver.HStore(310): Store=106264d98f4159c78cc8f13df7eabf30/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-15 21:12:47,052 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/data/default/testtb-testExportFileSystemStateWithSkipTmp/106264d98f4159c78cc8f13df7eabf30 2023-07-15 21:12:47,052 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/data/default/testtb-testExportFileSystemStateWithSkipTmp/adb292f49877fba2e1d2c5f9b3cec3ec 2023-07-15 21:12:47,052 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/data/default/testtb-testExportFileSystemStateWithSkipTmp/adb292f49877fba2e1d2c5f9b3cec3ec 2023-07-15 21:12:47,052 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/data/default/testtb-testExportFileSystemStateWithSkipTmp/106264d98f4159c78cc8f13df7eabf30 2023-07-15 21:12:47,055 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 106264d98f4159c78cc8f13df7eabf30 2023-07-15 21:12:47,055 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for adb292f49877fba2e1d2c5f9b3cec3ec 2023-07-15 21:12:47,058 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/data/default/testtb-testExportFileSystemStateWithSkipTmp/106264d98f4159c78cc8f13df7eabf30/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-15 21:12:47,059 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 106264d98f4159c78cc8f13df7eabf30; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64302050, jitterRate=-0.041824787855148315}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-15 21:12:47,059 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/data/default/testtb-testExportFileSystemStateWithSkipTmp/adb292f49877fba2e1d2c5f9b3cec3ec/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-15 21:12:47,059 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 106264d98f4159c78cc8f13df7eabf30: 2023-07-15 21:12:47,059 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened adb292f49877fba2e1d2c5f9b3cec3ec; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68818536, jitterRate=0.02547609806060791}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-15 21:12:47,059 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for adb292f49877fba2e1d2c5f9b3cec3ec: 2023-07-15 21:12:47,060 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithSkipTmp,,1689455566525.106264d98f4159c78cc8f13df7eabf30., pid=108, masterSystemTime=1689455567040 2023-07-15 21:12:47,060 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithSkipTmp,1,1689455566525.adb292f49877fba2e1d2c5f9b3cec3ec., pid=109, masterSystemTime=1689455567040 2023-07-15 21:12:47,061 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithSkipTmp,,1689455566525.106264d98f4159c78cc8f13df7eabf30. 2023-07-15 21:12:47,061 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithSkipTmp,,1689455566525.106264d98f4159c78cc8f13df7eabf30. 2023-07-15 21:12:47,062 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=106264d98f4159c78cc8f13df7eabf30, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,39075,1689455452043 2023-07-15 21:12:47,062 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithSkipTmp,1,1689455566525.adb292f49877fba2e1d2c5f9b3cec3ec. 2023-07-15 21:12:47,062 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithSkipTmp,1,1689455566525.adb292f49877fba2e1d2c5f9b3cec3ec. 2023-07-15 21:12:47,062 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689455566525.106264d98f4159c78cc8f13df7eabf30.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689455567062"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689455567062"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689455567062"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689455567062"}]},"ts":"1689455567062"} 2023-07-15 21:12:47,062 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=adb292f49877fba2e1d2c5f9b3cec3ec, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,39587,1689455451998 2023-07-15 21:12:47,062 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689455566525.adb292f49877fba2e1d2c5f9b3cec3ec.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689455567062"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689455567062"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689455567062"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689455567062"}]},"ts":"1689455567062"} 2023-07-15 21:12:47,065 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=108, resume processing ppid=106 2023-07-15 21:12:47,065 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=108, ppid=106, state=SUCCESS; OpenRegionProcedure 106264d98f4159c78cc8f13df7eabf30, server=jenkins-hbase4.apache.org,39075,1689455452043 in 178 msec 2023-07-15 21:12:47,067 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=109, resume processing ppid=107 2023-07-15 21:12:47,067 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=109, ppid=107, state=SUCCESS; OpenRegionProcedure adb292f49877fba2e1d2c5f9b3cec3ec, server=jenkins-hbase4.apache.org,39587,1689455451998 in 177 msec 2023-07-15 21:12:47,067 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=106, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=106264d98f4159c78cc8f13df7eabf30, ASSIGN in 342 msec 2023-07-15 21:12:47,068 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=107, resume processing ppid=105 2023-07-15 21:12:47,069 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=107, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=adb292f49877fba2e1d2c5f9b3cec3ec, ASSIGN in 344 msec 2023-07-15 21:12:47,069 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-15 21:12:47,069 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689455567069"}]},"ts":"1689455567069"} 2023-07-15 21:12:47,070 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=ENABLED in hbase:meta 2023-07-15 21:12:47,073 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_POST_OPERATION 2023-07-15 21:12:47,073 DEBUG [PEWorker-4] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithSkipTmp jenkins: RWXCA 2023-07-15 21:12:47,075 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=39075] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-07-15 21:12:47,076 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): regionserver:39587-0x1016ad2d8bb0002, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 21:12:47,076 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): master:36465-0x1016ad2d8bb0000, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 21:12:47,076 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): regionserver:37853-0x1016ad2d8bb0001, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 21:12:47,076 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): regionserver:39075-0x1016ad2d8bb0003, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 21:12:47,078 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-07-15 21:12:47,078 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-07-15 21:12:47,078 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-07-15 21:12:47,078 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-07-15 21:12:47,079 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=105, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 553 msec 2023-07-15 21:12:47,135 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36465] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-15 21:12:47,135 INFO [Listener at jenkins-hbase4.apache.org/41711] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 105 completed 2023-07-15 21:12:47,138 DEBUG [Listener at jenkins-hbase4.apache.org/41711] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithSkipTmp 2023-07-15 21:12:47,138 DEBUG [Listener at jenkins-hbase4.apache.org/41711] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithSkipTmp,,1689455566525.106264d98f4159c78cc8f13df7eabf30. 2023-07-15 21:12:47,140 INFO [Listener at jenkins-hbase4.apache.org/41711] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-15 21:12:47,160 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36465] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-15 21:12:47,160 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36465] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689455567160 (current time:1689455567160). 2023-07-15 21:12:47,160 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36465] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-15 21:12:47,160 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36465] zookeeper.ReadOnlyZKClient(139): Connect 0x20ad3ef0 to 127.0.0.1:50024 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-15 21:12:47,187 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36465] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@21672435, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-15 21:12:47,195 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36465] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-15 21:12:47,201 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:57456, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-15 21:12:47,202 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36465] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x20ad3ef0 to 127.0.0.1:50024 2023-07-15 21:12:47,202 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36465] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-15 21:12:47,203 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36465] zookeeper.ReadOnlyZKClient(139): Connect 0x76839907 to 127.0.0.1:50024 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-15 21:12:47,219 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36465] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3f106399, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-15 21:12:47,221 DEBUG [hconnection-0x27ceaec2-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-15 21:12:47,223 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:57468, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-15 21:12:47,230 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36465] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x76839907 to 127.0.0.1:50024 2023-07-15 21:12:47,230 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36465] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-15 21:12:47,230 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36465] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-07-15 21:12:47,231 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36465] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-15 21:12:47,231 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36465] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-15 21:12:47,233 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36465] procedure2.ProcedureExecutor(1029): Stored pid=110, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-15 21:12:47,234 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=110, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-15 21:12:47,235 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=110, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE; timeout=600000, timestamp=1689456167235 2023-07-15 21:12:47,235 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36465] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-15 21:12:47,236 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp 2023-07-15 21:12:47,236 DEBUG [Listener at jenkins-hbase4.apache.org/41711] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-15 21:12:47,236 DEBUG [Listener at jenkins-hbase4.apache.org/41711] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-15 21:12:47,240 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=110, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-15 21:12:47,240 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=111, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-15 21:12:47,242 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=110, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE in 7 msec 2023-07-15 21:12:47,243 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=111, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-15 21:12:47,244 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=111, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED; timeout=600000, timestamp=1689456167244 2023-07-15 21:12:47,268 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 21:12:47,268 INFO [(jenkins-hbase4.apache.org,36465,1689455450507)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' 2023-07-15 21:12:47,268 DEBUG [(jenkins-hbase4.apache.org,36465,1689455450507)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 21:12:47,270 DEBUG [(jenkins-hbase4.apache.org,36465,1689455450507)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' 2023-07-15 21:12:47,270 DEBUG [(jenkins-hbase4.apache.org,36465,1689455450507)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp', kicking off acquire phase on members. 2023-07-15 21:12:47,271 DEBUG [(jenkins-hbase4.apache.org,36465,1689455450507)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36465-0x1016ad2d8bb0000, quorum=127.0.0.1:50024, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 21:12:47,271 DEBUG [(jenkins-hbase4.apache.org,36465,1689455450507)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 21:12:47,272 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): regionserver:39587-0x1016ad2d8bb0002, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 21:12:47,272 DEBUG [(jenkins-hbase4.apache.org,36465,1689455450507)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39587,1689455451998 2023-07-15 21:12:47,272 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 21:12:47,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 21:12:47,272 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): regionserver:37853-0x1016ad2d8bb0001, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 21:12:47,272 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): regionserver:39075-0x1016ad2d8bb0003, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 21:12:47,272 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 21:12:47,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 21:12:47,272 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 21:12:47,272 DEBUG [(jenkins-hbase4.apache.org,36465,1689455450507)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36465-0x1016ad2d8bb0000, quorum=127.0.0.1:50024, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39587,1689455451998 2023-07-15 21:12:47,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 21:12:47,272 DEBUG [(jenkins-hbase4.apache.org,36465,1689455450507)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39075,1689455452043 2023-07-15 21:12:47,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 21:12:47,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 21:12:47,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 21:12:47,273 DEBUG [(jenkins-hbase4.apache.org,36465,1689455450507)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36465-0x1016ad2d8bb0000, quorum=127.0.0.1:50024, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39075,1689455452043 2023-07-15 21:12:47,273 DEBUG [(jenkins-hbase4.apache.org,36465,1689455450507)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-15 21:12:47,273 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39587-0x1016ad2d8bb0002, quorum=127.0.0.1:50024, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 21:12:47,273 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39075-0x1016ad2d8bb0003, quorum=127.0.0.1:50024, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 21:12:47,273 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37853-0x1016ad2d8bb0001, quorum=127.0.0.1:50024, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 21:12:47,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-07-15 21:12:47,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 21:12:47,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-07-15 21:12:47,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 21:12:47,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-07-15 21:12:47,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 21:12:47,274 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-15 21:12:47,273 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-15 21:12:47,274 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-15 21:12:47,274 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 21:12:47,274 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 21:12:47,274 DEBUG [member: 'jenkins-hbase4.apache.org,37853,1689455451932' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-15 21:12:47,274 DEBUG [member: 'jenkins-hbase4.apache.org,37853,1689455451932' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 21:12:47,274 DEBUG [member: 'jenkins-hbase4.apache.org,39075,1689455452043' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-15 21:12:47,274 DEBUG [member: 'jenkins-hbase4.apache.org,39075,1689455452043' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 21:12:47,276 DEBUG [member: 'jenkins-hbase4.apache.org,37853,1689455451932' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-15 21:12:47,276 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 21:12:47,276 DEBUG [member: 'jenkins-hbase4.apache.org,37853,1689455451932' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-15 21:12:47,276 DEBUG [member: 'jenkins-hbase4.apache.org,37853,1689455451932' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37853,1689455451932' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-15 21:12:47,276 DEBUG [member: 'jenkins-hbase4.apache.org,39075,1689455452043' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-15 21:12:47,276 DEBUG [member: 'jenkins-hbase4.apache.org,39075,1689455452043' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-15 21:12:47,276 DEBUG [member: 'jenkins-hbase4.apache.org,39075,1689455452043' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39075,1689455452043' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-15 21:12:47,276 DEBUG [member: 'jenkins-hbase4.apache.org,39587,1689455451998' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-15 21:12:47,276 DEBUG [member: 'jenkins-hbase4.apache.org,39587,1689455451998' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 21:12:47,278 DEBUG [member: 'jenkins-hbase4.apache.org,39587,1689455451998' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-15 21:12:47,278 DEBUG [member: 'jenkins-hbase4.apache.org,39587,1689455451998' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-15 21:12:47,278 DEBUG [member: 'jenkins-hbase4.apache.org,39587,1689455451998' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39587,1689455451998' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-15 21:12:47,283 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): master:36465-0x1016ad2d8bb0000, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39587,1689455451998 2023-07-15 21:12:47,283 DEBUG [member: 'jenkins-hbase4.apache.org,39587,1689455451998' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 21:12:47,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39587,1689455451998 2023-07-15 21:12:47,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 21:12:47,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 21:12:47,284 DEBUG [member: 'jenkins-hbase4.apache.org,37853,1689455451932' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 21:12:47,285 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): master:36465-0x1016ad2d8bb0000, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39075,1689455452043 2023-07-15 21:12:47,285 DEBUG [member: 'jenkins-hbase4.apache.org,39075,1689455452043' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 21:12:47,285 DEBUG [member: 'jenkins-hbase4.apache.org,37853,1689455451932' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37853-0x1016ad2d8bb0001, quorum=127.0.0.1:50024, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 21:12:47,285 DEBUG [member: 'jenkins-hbase4.apache.org,37853,1689455451932' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-15 21:12:47,285 DEBUG [member: 'jenkins-hbase4.apache.org,39587,1689455451998' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39587-0x1016ad2d8bb0002, quorum=127.0.0.1:50024, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 21:12:47,285 DEBUG [member: 'jenkins-hbase4.apache.org,39587,1689455451998' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-15 21:12:47,285 DEBUG [member: 'jenkins-hbase4.apache.org,39075,1689455452043' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39075-0x1016ad2d8bb0003, quorum=127.0.0.1:50024, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 21:12:47,285 DEBUG [member: 'jenkins-hbase4.apache.org,39075,1689455452043' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-15 21:12:47,285 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 21:12:47,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 21:12:47,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 21:12:47,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39075,1689455452043 2023-07-15 21:12:47,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39587,1689455451998 2023-07-15 21:12:47,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37853,1689455451932 2023-07-15 21:12:47,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 21:12:47,287 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39587,1689455451998' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-07-15 21:12:47,288 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@658ca244[Count = 1] remaining members to acquire global barrier 2023-07-15 21:12:47,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39075,1689455452043 2023-07-15 21:12:47,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 21:12:47,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 21:12:47,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 21:12:47,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 21:12:47,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 21:12:47,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39075,1689455452043 2023-07-15 21:12:47,293 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39587,1689455451998 2023-07-15 21:12:47,293 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37853,1689455451932 2023-07-15 21:12:47,293 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 21:12:47,293 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39075,1689455452043' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-07-15 21:12:47,294 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@658ca244[Count = 0] remaining members to acquire global barrier 2023-07-15 21:12:47,294 DEBUG [(jenkins-hbase4.apache.org,36465,1689455450507)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'in-barrier' execution. 2023-07-15 21:12:47,294 DEBUG [(jenkins-hbase4.apache.org,36465,1689455450507)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 21:12:47,295 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): regionserver:39587-0x1016ad2d8bb0002, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 21:12:47,295 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): regionserver:37853-0x1016ad2d8bb0001, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 21:12:47,295 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 21:12:47,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 21:12:47,295 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): regionserver:39075-0x1016ad2d8bb0003, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 21:12:47,295 DEBUG [member: 'jenkins-hbase4.apache.org,39587,1689455451998' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-15 21:12:47,295 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 21:12:47,295 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 21:12:47,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 21:12:47,295 DEBUG [(jenkins-hbase4.apache.org,36465,1689455450507)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36465-0x1016ad2d8bb0000, quorum=127.0.0.1:50024, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39587,1689455451998 2023-07-15 21:12:47,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 21:12:47,295 DEBUG [member: 'jenkins-hbase4.apache.org,37853,1689455451932' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-15 21:12:47,296 DEBUG [member: 'jenkins-hbase4.apache.org,39075,1689455452043' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-15 21:12:47,296 DEBUG [member: 'jenkins-hbase4.apache.org,37853,1689455451932' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-15 21:12:47,296 DEBUG [member: 'jenkins-hbase4.apache.org,37853,1689455451932' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,37853,1689455451932' in zk 2023-07-15 21:12:47,297 DEBUG [member: 'jenkins-hbase4.apache.org,39587,1689455451998' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-15 21:12:47,297 DEBUG [member: 'jenkins-hbase4.apache.org,39587,1689455451998' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-15 21:12:47,297 DEBUG [rs(jenkins-hbase4.apache.org,39587,1689455451998)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1689455566525.adb292f49877fba2e1d2c5f9b3cec3ec. 2023-07-15 21:12:47,297 DEBUG [rs(jenkins-hbase4.apache.org,39587,1689455451998)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1689455566525.adb292f49877fba2e1d2c5f9b3cec3ec. started... 2023-07-15 21:12:47,298 DEBUG [member: 'jenkins-hbase4.apache.org,39075,1689455452043' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-15 21:12:47,309 DEBUG [member: 'jenkins-hbase4.apache.org,39075,1689455452043' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-15 21:12:47,307 DEBUG [rs(jenkins-hbase4.apache.org,39075,1689455452043)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1689455566525.106264d98f4159c78cc8f13df7eabf30. 2023-07-15 21:12:47,306 DEBUG [rs(jenkins-hbase4.apache.org,39587,1689455451998)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for adb292f49877fba2e1d2c5f9b3cec3ec: 2023-07-15 21:12:47,309 DEBUG [member: 'jenkins-hbase4.apache.org,37853,1689455451932' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-15 21:12:47,314 DEBUG [member: 'jenkins-hbase4.apache.org,37853,1689455451932' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 21:12:47,314 DEBUG [member: 'jenkins-hbase4.apache.org,37853,1689455451932' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-15 21:12:47,315 DEBUG [rs(jenkins-hbase4.apache.org,39587,1689455451998)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,1,1689455566525.adb292f49877fba2e1d2c5f9b3cec3ec.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 21:12:47,315 DEBUG [rs(jenkins-hbase4.apache.org,39587,1689455451998)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-15 21:12:47,315 DEBUG [rs(jenkins-hbase4.apache.org,39587,1689455451998)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-15 21:12:47,315 DEBUG [(jenkins-hbase4.apache.org,36465,1689455450507)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36465-0x1016ad2d8bb0000, quorum=127.0.0.1:50024, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39075,1689455452043 2023-07-15 21:12:47,315 DEBUG [(jenkins-hbase4.apache.org,36465,1689455450507)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-15 21:12:47,309 DEBUG [rs(jenkins-hbase4.apache.org,39075,1689455452043)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1689455566525.106264d98f4159c78cc8f13df7eabf30. started... 2023-07-15 21:12:47,318 DEBUG [rs(jenkins-hbase4.apache.org,39075,1689455452043)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 106264d98f4159c78cc8f13df7eabf30: 2023-07-15 21:12:47,318 DEBUG [rs(jenkins-hbase4.apache.org,39075,1689455452043)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,,1689455566525.106264d98f4159c78cc8f13df7eabf30.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 21:12:47,318 DEBUG [rs(jenkins-hbase4.apache.org,39075,1689455452043)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-15 21:12:47,318 DEBUG [rs(jenkins-hbase4.apache.org,39075,1689455452043)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-15 21:12:47,336 DEBUG [Listener at jenkins-hbase4.apache.org/41711] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-15 21:12:47,338 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36465] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-15 21:12:47,338 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36465] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-07-15 21:12:47,339 DEBUG [Listener at jenkins-hbase4.apache.org/41711] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-15 21:12:47,422 DEBUG [rs(jenkins-hbase4.apache.org,39075,1689455452043)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1689455566525.106264d98f4159c78cc8f13df7eabf30. completed. 2023-07-15 21:12:47,422 DEBUG [rs(jenkins-hbase4.apache.org,39075,1689455452043)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1689455566525.106264d98f4159c78cc8f13df7eabf30. 2023-07-15 21:12:47,422 DEBUG [member: 'jenkins-hbase4.apache.org,39075,1689455452043' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-15 21:12:47,422 DEBUG [member: 'jenkins-hbase4.apache.org,39075,1689455452043' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-15 21:12:47,422 DEBUG [member: 'jenkins-hbase4.apache.org,39075,1689455452043' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,39075,1689455452043 2023-07-15 21:12:47,422 DEBUG [member: 'jenkins-hbase4.apache.org,39075,1689455452043' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-15 21:12:47,422 DEBUG [member: 'jenkins-hbase4.apache.org,39075,1689455452043' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,39075,1689455452043' in zk 2023-07-15 21:12:47,423 DEBUG [rs(jenkins-hbase4.apache.org,39587,1689455451998)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1689455566525.adb292f49877fba2e1d2c5f9b3cec3ec. completed. 2023-07-15 21:12:47,423 DEBUG [rs(jenkins-hbase4.apache.org,39587,1689455451998)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1689455566525.adb292f49877fba2e1d2c5f9b3cec3ec. 2023-07-15 21:12:47,423 DEBUG [member: 'jenkins-hbase4.apache.org,39587,1689455451998' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-15 21:12:47,423 DEBUG [member: 'jenkins-hbase4.apache.org,39587,1689455451998' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-15 21:12:47,424 DEBUG [member: 'jenkins-hbase4.apache.org,39587,1689455451998' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,39587,1689455451998 2023-07-15 21:12:47,424 DEBUG [member: 'jenkins-hbase4.apache.org,39587,1689455451998' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-15 21:12:47,424 DEBUG [member: 'jenkins-hbase4.apache.org,39587,1689455451998' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,39587,1689455451998' in zk 2023-07-15 21:12:47,424 DEBUG [member: 'jenkins-hbase4.apache.org,39075,1689455452043' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-15 21:12:47,424 DEBUG [member: 'jenkins-hbase4.apache.org,39075,1689455452043' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 21:12:47,424 DEBUG [member: 'jenkins-hbase4.apache.org,39075,1689455452043' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-15 21:12:47,427 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): master:36465-0x1016ad2d8bb0000, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39075,1689455452043 2023-07-15 21:12:47,427 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39075,1689455452043 2023-07-15 21:12:47,427 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 21:12:47,427 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 21:12:47,427 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): master:36465-0x1016ad2d8bb0000, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39587,1689455451998 2023-07-15 21:12:47,427 DEBUG [member: 'jenkins-hbase4.apache.org,39587,1689455451998' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-15 21:12:47,427 DEBUG [member: 'jenkins-hbase4.apache.org,39587,1689455451998' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 21:12:47,427 DEBUG [member: 'jenkins-hbase4.apache.org,39587,1689455451998' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-15 21:12:47,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 21:12:47,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 21:12:47,430 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 21:12:47,430 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39075,1689455452043 2023-07-15 21:12:47,430 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39587,1689455451998 2023-07-15 21:12:47,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37853,1689455451932 2023-07-15 21:12:47,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 21:12:47,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 21:12:47,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39075,1689455452043 2023-07-15 21:12:47,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39587,1689455451998 2023-07-15 21:12:47,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37853,1689455451932 2023-07-15 21:12:47,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,39075,1689455452043': 2023-07-15 21:12:47,433 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39075,1689455452043' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 1 more 2023-07-15 21:12:47,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39587,1689455451998 2023-07-15 21:12:47,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 21:12:47,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 21:12:47,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 21:12:47,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 21:12:47,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 21:12:47,435 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39075,1689455452043 2023-07-15 21:12:47,435 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39587,1689455451998 2023-07-15 21:12:47,435 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37853,1689455451932 2023-07-15 21:12:47,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 21:12:47,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 21:12:47,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39075,1689455452043 2023-07-15 21:12:47,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39587,1689455451998 2023-07-15 21:12:47,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37853,1689455451932 2023-07-15 21:12:47,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,39587,1689455451998': 2023-07-15 21:12:47,437 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39587,1689455451998' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 0 more 2023-07-15 21:12:47,437 INFO [(jenkins-hbase4.apache.org,36465,1689455450507)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' execution completed 2023-07-15 21:12:47,437 DEBUG [(jenkins-hbase4.apache.org,36465,1689455450507)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-15 21:12:47,437 DEBUG [(jenkins-hbase4.apache.org,36465,1689455450507)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-15 21:12:47,437 DEBUG [(jenkins-hbase4.apache.org,36465,1689455450507)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 21:12:47,437 INFO [(jenkins-hbase4.apache.org,36465,1689455450507)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateWithSkipTmpincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-15 21:12:47,440 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): master:36465-0x1016ad2d8bb0000, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 21:12:47,440 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): regionserver:37853-0x1016ad2d8bb0001, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 21:12:47,440 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): regionserver:39587-0x1016ad2d8bb0002, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 21:12:47,440 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 21:12:47,440 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 21:12:47,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 21:12:47,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 21:12:47,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 21:12:47,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 21:12:47,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 21:12:47,440 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): regionserver:39587-0x1016ad2d8bb0002, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 21:12:47,440 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): regionserver:39075-0x1016ad2d8bb0003, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 21:12:47,441 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): regionserver:39075-0x1016ad2d8bb0003, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 21:12:47,441 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 21:12:47,440 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): regionserver:37853-0x1016ad2d8bb0001, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 21:12:47,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 21:12:47,442 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 21:12:47,442 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 21:12:47,442 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 21:12:47,442 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 21:12:47,442 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 21:12:47,442 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 21:12:47,442 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 21:12:47,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 21:12:47,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 21:12:47,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 21:12:47,444 DEBUG [(jenkins-hbase4.apache.org,36465,1689455450507)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36465-0x1016ad2d8bb0000, quorum=127.0.0.1:50024, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39075,1689455452043 2023-07-15 21:12:47,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 21:12:47,444 DEBUG [(jenkins-hbase4.apache.org,36465,1689455450507)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36465-0x1016ad2d8bb0000, quorum=127.0.0.1:50024, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39587,1689455451998 2023-07-15 21:12:47,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 21:12:47,445 DEBUG [(jenkins-hbase4.apache.org,36465,1689455450507)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36465-0x1016ad2d8bb0000, quorum=127.0.0.1:50024, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37853,1689455451932 2023-07-15 21:12:47,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 21:12:47,446 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39075,1689455452043 2023-07-15 21:12:47,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39587,1689455451998 2023-07-15 21:12:47,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37853,1689455451932 2023-07-15 21:12:47,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 21:12:47,447 DEBUG [(jenkins-hbase4.apache.org,36465,1689455450507)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36465-0x1016ad2d8bb0000, quorum=127.0.0.1:50024, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39075,1689455452043 2023-07-15 21:12:47,448 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 21:12:47,448 DEBUG [(jenkins-hbase4.apache.org,36465,1689455450507)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36465-0x1016ad2d8bb0000, quorum=127.0.0.1:50024, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39587,1689455451998 2023-07-15 21:12:47,448 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39075,1689455452043 2023-07-15 21:12:47,448 DEBUG [(jenkins-hbase4.apache.org,36465,1689455450507)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36465-0x1016ad2d8bb0000, quorum=127.0.0.1:50024, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37853,1689455451932 2023-07-15 21:12:47,448 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39587,1689455451998 2023-07-15 21:12:47,448 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37853,1689455451932 2023-07-15 21:12:47,452 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): master:36465-0x1016ad2d8bb0000, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37853,1689455451932 2023-07-15 21:12:47,452 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): regionserver:39075-0x1016ad2d8bb0003, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 21:12:47,452 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): regionserver:39075-0x1016ad2d8bb0003, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 21:12:47,452 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 21:12:47,452 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 21:12:47,452 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): regionserver:37853-0x1016ad2d8bb0001, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 21:12:47,452 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): regionserver:37853-0x1016ad2d8bb0001, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 21:12:47,452 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 21:12:47,452 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 21:12:47,452 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): regionserver:39587-0x1016ad2d8bb0002, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 21:12:47,453 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): regionserver:39587-0x1016ad2d8bb0002, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 21:12:47,453 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 21:12:47,453 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): master:36465-0x1016ad2d8bb0000, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 21:12:47,453 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 21:12:47,453 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): master:36465-0x1016ad2d8bb0000, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39587,1689455451998 2023-07-15 21:12:47,453 DEBUG [(jenkins-hbase4.apache.org,36465,1689455450507)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 21:12:47,453 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 21:12:47,453 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 21:12:47,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 21:12:47,455 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 21:12:47,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 21:12:47,455 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 21:12:47,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 21:12:47,453 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): master:36465-0x1016ad2d8bb0000, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39075,1689455452043 2023-07-15 21:12:47,453 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithSkipTmp 2023-07-15 21:12:47,459 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => e9516f04c7d2974b21addb190acc6c0a, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,.mob,0.e9516f04c7d2974b21addb190acc6c0a.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 21:12:47,458 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): master:36465-0x1016ad2d8bb0000, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 21:12:47,459 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-15 21:12:47,459 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): master:36465-0x1016ad2d8bb0000, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37853,1689455451932 2023-07-15 21:12:47,459 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): master:36465-0x1016ad2d8bb0000, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 21:12:47,459 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): master:36465-0x1016ad2d8bb0000, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39587,1689455451998 2023-07-15 21:12:47,459 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): master:36465-0x1016ad2d8bb0000, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39075,1689455452043 2023-07-15 21:12:47,459 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): master:36465-0x1016ad2d8bb0000, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 21:12:47,459 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): master:36465-0x1016ad2d8bb0000, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 21:12:47,459 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-07-15 21:12:47,477 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 21:12:47,478 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 21:12:47,534 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/.hbase-snapshot/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 21:12:47,539 DEBUG [Listener at jenkins-hbase4.apache.org/41711] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-15 21:12:47,540 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36465] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-15 21:12:47,540 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36465] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-07-15 21:12:47,541 DEBUG [Listener at jenkins-hbase4.apache.org/41711] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-15 21:12:47,594 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed 2023-07-15 21:12:47,595 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 21:12:47,595 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 21:12:47,595 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp at 1689455567236Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithSkipTmp at 1689455567477 (+241 ms)Consolidate snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1689455567477Loading Region manifests for emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1689455567477Writing data manifest for emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1689455567487 (+10 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1689455567524 (+37 ms)Snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed at 1689455567594 (+70 ms) 2023-07-15 21:12:47,599 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=111, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-15 21:12:47,602 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=111, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED in 361 msec 2023-07-15 21:12:47,841 DEBUG [Listener at jenkins-hbase4.apache.org/41711] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-15 21:12:47,842 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36465] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-15 21:12:47,842 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36465] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-15 21:12:47,845 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39075] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithSkipTmp,,1689455566525.106264d98f4159c78cc8f13df7eabf30. with WAL disabled. Data may be lost in the event of a crash. 2023-07-15 21:12:47,846 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39587] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithSkipTmp,1,1689455566525.adb292f49877fba2e1d2c5f9b3cec3ec. with WAL disabled. Data may be lost in the event of a crash. 2023-07-15 21:12:47,849 DEBUG [Listener at jenkins-hbase4.apache.org/41711] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithSkipTmp 2023-07-15 21:12:47,849 DEBUG [Listener at jenkins-hbase4.apache.org/41711] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithSkipTmp,,1689455566525.106264d98f4159c78cc8f13df7eabf30. 2023-07-15 21:12:47,849 INFO [Listener at jenkins-hbase4.apache.org/41711] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-15 21:12:47,859 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36465] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-15 21:12:47,859 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36465] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689455567859 (current time:1689455567859). 2023-07-15 21:12:47,859 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36465] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-15 21:12:47,860 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36465] zookeeper.ReadOnlyZKClient(139): Connect 0x712460bc to 127.0.0.1:50024 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-15 21:12:47,867 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36465] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@234e78e4, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-15 21:12:47,868 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36465] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-15 21:12:47,871 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:57470, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-15 21:12:47,872 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36465] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x712460bc to 127.0.0.1:50024 2023-07-15 21:12:47,872 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36465] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-15 21:12:47,873 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36465] zookeeper.ReadOnlyZKClient(139): Connect 0x46f8d48d to 127.0.0.1:50024 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-15 21:12:47,882 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36465] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@140b6d6e, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-15 21:12:47,885 DEBUG [hconnection-0x44d2be53-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-15 21:12:47,888 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:57480, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-15 21:12:47,893 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36465] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x46f8d48d to 127.0.0.1:50024 2023-07-15 21:12:47,894 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36465] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-15 21:12:47,894 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36465] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-07-15 21:12:47,895 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36465] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-15 21:12:47,895 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36465] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-15 21:12:47,897 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36465] procedure2.ProcedureExecutor(1029): Stored pid=112, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-15 21:12:47,899 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=112, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-15 21:12:47,900 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=112, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE; timeout=600000, timestamp=1689456167900 2023-07-15 21:12:47,900 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36465] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-15 21:12:47,900 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp 2023-07-15 21:12:47,901 DEBUG [Listener at jenkins-hbase4.apache.org/41711] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-15 21:12:47,901 DEBUG [Listener at jenkins-hbase4.apache.org/41711] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-15 21:12:47,902 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=113, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-15 21:12:47,903 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=112, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-15 21:12:47,904 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=112, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE in 7 msec 2023-07-15 21:12:47,905 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=113, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-15 21:12:47,906 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=113, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED; timeout=600000, timestamp=1689456167906 2023-07-15 21:12:47,923 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 21:12:47,923 INFO [(jenkins-hbase4.apache.org,36465,1689455450507)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' 2023-07-15 21:12:47,924 DEBUG [(jenkins-hbase4.apache.org,36465,1689455450507)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 21:12:47,925 DEBUG [(jenkins-hbase4.apache.org,36465,1689455450507)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' 2023-07-15 21:12:47,925 DEBUG [(jenkins-hbase4.apache.org,36465,1689455450507)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithSkipTmp', kicking off acquire phase on members. 2023-07-15 21:12:47,926 DEBUG [(jenkins-hbase4.apache.org,36465,1689455450507)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36465-0x1016ad2d8bb0000, quorum=127.0.0.1:50024, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 21:12:47,926 DEBUG [(jenkins-hbase4.apache.org,36465,1689455450507)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 21:12:47,927 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): regionserver:39075-0x1016ad2d8bb0003, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 21:12:47,927 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): regionserver:37853-0x1016ad2d8bb0001, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 21:12:47,927 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 21:12:47,927 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 21:12:47,927 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 21:12:47,927 DEBUG [(jenkins-hbase4.apache.org,36465,1689455450507)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39587,1689455451998 2023-07-15 21:12:47,927 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): regionserver:39587-0x1016ad2d8bb0002, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 21:12:47,927 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 21:12:47,927 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 21:12:47,927 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 21:12:47,928 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 21:12:47,928 DEBUG [(jenkins-hbase4.apache.org,36465,1689455450507)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36465-0x1016ad2d8bb0000, quorum=127.0.0.1:50024, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39587,1689455451998 2023-07-15 21:12:47,928 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 21:12:47,928 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 21:12:47,928 DEBUG [(jenkins-hbase4.apache.org,36465,1689455450507)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39075,1689455452043 2023-07-15 21:12:47,928 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37853-0x1016ad2d8bb0001, quorum=127.0.0.1:50024, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 21:12:47,928 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39075-0x1016ad2d8bb0003, quorum=127.0.0.1:50024, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 21:12:47,928 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39587-0x1016ad2d8bb0002, quorum=127.0.0.1:50024, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 21:12:47,928 DEBUG [(jenkins-hbase4.apache.org,36465,1689455450507)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36465-0x1016ad2d8bb0000, quorum=127.0.0.1:50024, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39075,1689455452043 2023-07-15 21:12:47,928 DEBUG [(jenkins-hbase4.apache.org,36465,1689455450507)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-15 21:12:47,935 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-07-15 21:12:47,935 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 21:12:47,935 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-07-15 21:12:47,935 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 21:12:47,935 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-07-15 21:12:47,935 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-15 21:12:47,935 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-15 21:12:47,935 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 21:12:47,935 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 21:12:47,935 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-15 21:12:47,935 DEBUG [member: 'jenkins-hbase4.apache.org,37853,1689455451932' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-15 21:12:47,935 DEBUG [member: 'jenkins-hbase4.apache.org,37853,1689455451932' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 21:12:47,935 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 21:12:47,935 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 21:12:47,935 DEBUG [member: 'jenkins-hbase4.apache.org,39587,1689455451998' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-15 21:12:47,935 DEBUG [member: 'jenkins-hbase4.apache.org,39075,1689455452043' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-15 21:12:47,935 DEBUG [member: 'jenkins-hbase4.apache.org,39075,1689455452043' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 21:12:47,935 DEBUG [member: 'jenkins-hbase4.apache.org,39587,1689455451998' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 21:12:47,937 DEBUG [member: 'jenkins-hbase4.apache.org,39075,1689455452043' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-15 21:12:47,938 DEBUG [member: 'jenkins-hbase4.apache.org,39587,1689455451998' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-15 21:12:47,938 DEBUG [member: 'jenkins-hbase4.apache.org,39075,1689455452043' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-15 21:12:47,938 DEBUG [member: 'jenkins-hbase4.apache.org,39075,1689455452043' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39075,1689455452043' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-15 21:12:47,937 DEBUG [member: 'jenkins-hbase4.apache.org,37853,1689455451932' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-15 21:12:47,938 DEBUG [member: 'jenkins-hbase4.apache.org,37853,1689455451932' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-15 21:12:47,938 DEBUG [member: 'jenkins-hbase4.apache.org,39587,1689455451998' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-15 21:12:47,938 DEBUG [member: 'jenkins-hbase4.apache.org,39587,1689455451998' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39587,1689455451998' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-15 21:12:47,938 DEBUG [member: 'jenkins-hbase4.apache.org,37853,1689455451932' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37853,1689455451932' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-15 21:12:47,940 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): master:36465-0x1016ad2d8bb0000, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39587,1689455451998 2023-07-15 21:12:47,940 DEBUG [member: 'jenkins-hbase4.apache.org,39587,1689455451998' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 21:12:47,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39587,1689455451998 2023-07-15 21:12:47,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 21:12:47,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 21:12:47,946 DEBUG [member: 'jenkins-hbase4.apache.org,39075,1689455452043' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 21:12:47,946 DEBUG [member: 'jenkins-hbase4.apache.org,39587,1689455451998' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39587-0x1016ad2d8bb0002, quorum=127.0.0.1:50024, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 21:12:47,946 DEBUG [member: 'jenkins-hbase4.apache.org,39587,1689455451998' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-15 21:12:47,947 DEBUG [member: 'jenkins-hbase4.apache.org,39075,1689455452043' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39075-0x1016ad2d8bb0003, quorum=127.0.0.1:50024, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 21:12:47,947 DEBUG [member: 'jenkins-hbase4.apache.org,39075,1689455452043' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-15 21:12:47,948 DEBUG [member: 'jenkins-hbase4.apache.org,37853,1689455451932' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 21:12:47,948 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): master:36465-0x1016ad2d8bb0000, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39075,1689455452043 2023-07-15 21:12:47,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 21:12:47,948 DEBUG [member: 'jenkins-hbase4.apache.org,37853,1689455451932' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37853-0x1016ad2d8bb0001, quorum=127.0.0.1:50024, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 21:12:47,948 DEBUG [member: 'jenkins-hbase4.apache.org,37853,1689455451932' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-15 21:12:47,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 21:12:47,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 21:12:47,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39075,1689455452043 2023-07-15 21:12:47,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39587,1689455451998 2023-07-15 21:12:47,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37853,1689455451932 2023-07-15 21:12:47,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 21:12:47,951 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39587,1689455451998' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-07-15 21:12:47,951 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4beb5b97[Count = 1] remaining members to acquire global barrier 2023-07-15 21:12:47,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39075,1689455452043 2023-07-15 21:12:47,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 21:12:47,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 21:12:47,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 21:12:47,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 21:12:47,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 21:12:47,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39075,1689455452043 2023-07-15 21:12:47,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39587,1689455451998 2023-07-15 21:12:47,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37853,1689455451932 2023-07-15 21:12:47,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 21:12:47,953 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39075,1689455452043' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-07-15 21:12:47,954 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4beb5b97[Count = 0] remaining members to acquire global barrier 2023-07-15 21:12:47,954 DEBUG [(jenkins-hbase4.apache.org,36465,1689455450507)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'in-barrier' execution. 2023-07-15 21:12:47,954 DEBUG [(jenkins-hbase4.apache.org,36465,1689455450507)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 21:12:47,963 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): regionserver:39587-0x1016ad2d8bb0002, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 21:12:47,963 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): regionserver:39075-0x1016ad2d8bb0003, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 21:12:47,963 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 21:12:47,963 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 21:12:47,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 21:12:47,963 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): regionserver:37853-0x1016ad2d8bb0001, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 21:12:47,963 DEBUG [member: 'jenkins-hbase4.apache.org,39587,1689455451998' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-15 21:12:47,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 21:12:47,963 DEBUG [(jenkins-hbase4.apache.org,36465,1689455450507)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36465-0x1016ad2d8bb0000, quorum=127.0.0.1:50024, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39587,1689455451998 2023-07-15 21:12:47,963 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 21:12:47,964 DEBUG [member: 'jenkins-hbase4.apache.org,39587,1689455451998' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-15 21:12:47,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 21:12:47,964 DEBUG [rs(jenkins-hbase4.apache.org,39587,1689455451998)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1689455566525.adb292f49877fba2e1d2c5f9b3cec3ec. 2023-07-15 21:12:47,964 DEBUG [member: 'jenkins-hbase4.apache.org,37853,1689455451932' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-15 21:12:47,964 DEBUG [member: 'jenkins-hbase4.apache.org,37853,1689455451932' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-15 21:12:47,964 DEBUG [rs(jenkins-hbase4.apache.org,39587,1689455451998)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1689455566525.adb292f49877fba2e1d2c5f9b3cec3ec. started... 2023-07-15 21:12:47,964 DEBUG [(jenkins-hbase4.apache.org,36465,1689455450507)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36465-0x1016ad2d8bb0000, quorum=127.0.0.1:50024, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39075,1689455452043 2023-07-15 21:12:47,964 DEBUG [(jenkins-hbase4.apache.org,36465,1689455450507)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-15 21:12:47,964 DEBUG [member: 'jenkins-hbase4.apache.org,39587,1689455451998' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-15 21:12:47,964 DEBUG [member: 'jenkins-hbase4.apache.org,39075,1689455452043' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-15 21:12:47,964 DEBUG [member: 'jenkins-hbase4.apache.org,37853,1689455451932' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,37853,1689455451932' in zk 2023-07-15 21:12:47,964 INFO [rs(jenkins-hbase4.apache.org,39587,1689455451998)-snapshot-pool-0] regionserver.HRegion(2745): Flushing adb292f49877fba2e1d2c5f9b3cec3ec 1/1 column families, dataSize=3.00 KB heapSize=6.72 KB 2023-07-15 21:12:47,964 DEBUG [member: 'jenkins-hbase4.apache.org,39075,1689455452043' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-15 21:12:47,964 DEBUG [rs(jenkins-hbase4.apache.org,39075,1689455452043)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1689455566525.106264d98f4159c78cc8f13df7eabf30. 2023-07-15 21:12:47,964 DEBUG [member: 'jenkins-hbase4.apache.org,39075,1689455452043' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-15 21:12:47,964 DEBUG [rs(jenkins-hbase4.apache.org,39075,1689455452043)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1689455566525.106264d98f4159c78cc8f13df7eabf30. started... 2023-07-15 21:12:47,965 INFO [rs(jenkins-hbase4.apache.org,39075,1689455452043)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 106264d98f4159c78cc8f13df7eabf30 1/1 column families, dataSize=266 B heapSize=832 B 2023-07-15 21:12:47,966 DEBUG [member: 'jenkins-hbase4.apache.org,37853,1689455451932' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-15 21:12:47,966 DEBUG [member: 'jenkins-hbase4.apache.org,37853,1689455451932' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 21:12:47,967 DEBUG [member: 'jenkins-hbase4.apache.org,37853,1689455451932' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-15 21:12:48,002 DEBUG [Listener at jenkins-hbase4.apache.org/41711] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-15 21:12:48,003 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36465] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-15 21:12:48,004 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36465] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-07-15 21:12:48,004 DEBUG [Listener at jenkins-hbase4.apache.org/41711] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-15 21:12:48,007 INFO [rs(jenkins-hbase4.apache.org,39075,1689455452043)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202307155dfb0d6480444d81843c70a7f1a79d0a to hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e202307155dfb0d6480444d81843c70a7f1a79d0a 2023-07-15 21:12:48,008 INFO [rs(jenkins-hbase4.apache.org,39587,1689455451998)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230715a67957b005a14fb1a327a841aaef72b1 to hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b20230715a67957b005a14fb1a327a841aaef72b1 2023-07-15 21:12:48,033 INFO [rs(jenkins-hbase4.apache.org,39075,1689455452043)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=266, hasBloomFilter=true, into tmp file hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/data/default/testtb-testExportFileSystemStateWithSkipTmp/106264d98f4159c78cc8f13df7eabf30/.tmp/cf/56f6c373cbe94524913f410cba6f9b50 2023-07-15 21:12:48,035 INFO [rs(jenkins-hbase4.apache.org,39587,1689455451998)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.0 K, hasBloomFilter=true, into tmp file hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/data/default/testtb-testExportFileSystemStateWithSkipTmp/adb292f49877fba2e1d2c5f9b3cec3ec/.tmp/cf/baa7671450954e51aff1a55ebd91ee0e 2023-07-15 21:12:48,039 DEBUG [rs(jenkins-hbase4.apache.org,39075,1689455452043)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/data/default/testtb-testExportFileSystemStateWithSkipTmp/106264d98f4159c78cc8f13df7eabf30/.tmp/cf/56f6c373cbe94524913f410cba6f9b50 as hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/data/default/testtb-testExportFileSystemStateWithSkipTmp/106264d98f4159c78cc8f13df7eabf30/cf/56f6c373cbe94524913f410cba6f9b50 2023-07-15 21:12:48,040 DEBUG [rs(jenkins-hbase4.apache.org,39587,1689455451998)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/data/default/testtb-testExportFileSystemStateWithSkipTmp/adb292f49877fba2e1d2c5f9b3cec3ec/.tmp/cf/baa7671450954e51aff1a55ebd91ee0e as hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/data/default/testtb-testExportFileSystemStateWithSkipTmp/adb292f49877fba2e1d2c5f9b3cec3ec/cf/baa7671450954e51aff1a55ebd91ee0e 2023-07-15 21:12:48,045 INFO [rs(jenkins-hbase4.apache.org,39587,1689455451998)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/data/default/testtb-testExportFileSystemStateWithSkipTmp/adb292f49877fba2e1d2c5f9b3cec3ec/cf/baa7671450954e51aff1a55ebd91ee0e, entries=46, sequenceid=6, filesize=13.2 K 2023-07-15 21:12:48,047 INFO [rs(jenkins-hbase4.apache.org,39587,1689455451998)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.00 KB/3070, heapSize ~6.70 KB/6864, currentSize=0 B/0 for adb292f49877fba2e1d2c5f9b3cec3ec in 82ms, sequenceid=6, compaction requested=false 2023-07-15 21:12:48,047 DEBUG [rs(jenkins-hbase4.apache.org,39587,1689455451998)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithSkipTmp' 2023-07-15 21:12:48,047 INFO [rs(jenkins-hbase4.apache.org,39075,1689455452043)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/data/default/testtb-testExportFileSystemStateWithSkipTmp/106264d98f4159c78cc8f13df7eabf30/cf/56f6c373cbe94524913f410cba6f9b50, entries=4, sequenceid=6, filesize=5.6 K 2023-07-15 21:12:48,047 DEBUG [rs(jenkins-hbase4.apache.org,39587,1689455451998)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for adb292f49877fba2e1d2c5f9b3cec3ec: 2023-07-15 21:12:48,047 DEBUG [rs(jenkins-hbase4.apache.org,39587,1689455451998)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,1,1689455566525.adb292f49877fba2e1d2c5f9b3cec3ec.' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 21:12:48,047 DEBUG [rs(jenkins-hbase4.apache.org,39587,1689455451998)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-15 21:12:48,048 DEBUG [rs(jenkins-hbase4.apache.org,39587,1689455451998)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/data/default/testtb-testExportFileSystemStateWithSkipTmp/adb292f49877fba2e1d2c5f9b3cec3ec/cf/baa7671450954e51aff1a55ebd91ee0e] hfiles 2023-07-15 21:12:48,048 DEBUG [rs(jenkins-hbase4.apache.org,39587,1689455451998)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/data/default/testtb-testExportFileSystemStateWithSkipTmp/adb292f49877fba2e1d2c5f9b3cec3ec/cf/baa7671450954e51aff1a55ebd91ee0e for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 21:12:48,049 INFO [rs(jenkins-hbase4.apache.org,39075,1689455452043)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~266 B/266, heapSize ~816 B/816, currentSize=0 B/0 for 106264d98f4159c78cc8f13df7eabf30 in 84ms, sequenceid=6, compaction requested=false 2023-07-15 21:12:48,051 DEBUG [rs(jenkins-hbase4.apache.org,39075,1689455452043)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 106264d98f4159c78cc8f13df7eabf30: 2023-07-15 21:12:48,051 DEBUG [rs(jenkins-hbase4.apache.org,39075,1689455452043)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,,1689455566525.106264d98f4159c78cc8f13df7eabf30.' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 21:12:48,051 DEBUG [rs(jenkins-hbase4.apache.org,39075,1689455452043)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-15 21:12:48,052 DEBUG [rs(jenkins-hbase4.apache.org,39075,1689455452043)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/data/default/testtb-testExportFileSystemStateWithSkipTmp/106264d98f4159c78cc8f13df7eabf30/cf/56f6c373cbe94524913f410cba6f9b50] hfiles 2023-07-15 21:12:48,052 DEBUG [rs(jenkins-hbase4.apache.org,39075,1689455452043)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/data/default/testtb-testExportFileSystemStateWithSkipTmp/106264d98f4159c78cc8f13df7eabf30/cf/56f6c373cbe94524913f410cba6f9b50 for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 21:12:48,092 DEBUG [rs(jenkins-hbase4.apache.org,39587,1689455451998)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1689455566525.adb292f49877fba2e1d2c5f9b3cec3ec. completed. 2023-07-15 21:12:48,092 DEBUG [rs(jenkins-hbase4.apache.org,39587,1689455451998)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1689455566525.adb292f49877fba2e1d2c5f9b3cec3ec. 2023-07-15 21:12:48,092 DEBUG [member: 'jenkins-hbase4.apache.org,39587,1689455451998' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-15 21:12:48,092 DEBUG [member: 'jenkins-hbase4.apache.org,39587,1689455451998' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-15 21:12:48,092 DEBUG [member: 'jenkins-hbase4.apache.org,39587,1689455451998' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,39587,1689455451998 2023-07-15 21:12:48,092 DEBUG [member: 'jenkins-hbase4.apache.org,39587,1689455451998' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-15 21:12:48,092 DEBUG [rs(jenkins-hbase4.apache.org,39075,1689455452043)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1689455566525.106264d98f4159c78cc8f13df7eabf30. completed. 2023-07-15 21:12:48,093 DEBUG [rs(jenkins-hbase4.apache.org,39075,1689455452043)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1689455566525.106264d98f4159c78cc8f13df7eabf30. 2023-07-15 21:12:48,092 DEBUG [member: 'jenkins-hbase4.apache.org,39587,1689455451998' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,39587,1689455451998' in zk 2023-07-15 21:12:48,093 DEBUG [member: 'jenkins-hbase4.apache.org,39075,1689455452043' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-15 21:12:48,093 DEBUG [member: 'jenkins-hbase4.apache.org,39075,1689455452043' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-15 21:12:48,093 DEBUG [member: 'jenkins-hbase4.apache.org,39075,1689455452043' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,39075,1689455452043 2023-07-15 21:12:48,093 DEBUG [member: 'jenkins-hbase4.apache.org,39075,1689455452043' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-15 21:12:48,093 DEBUG [member: 'jenkins-hbase4.apache.org,39075,1689455452043' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,39075,1689455452043' in zk 2023-07-15 21:12:48,104 DEBUG [member: 'jenkins-hbase4.apache.org,39587,1689455451998' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-15 21:12:48,104 DEBUG [member: 'jenkins-hbase4.apache.org,39075,1689455452043' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-15 21:12:48,104 DEBUG [member: 'jenkins-hbase4.apache.org,39075,1689455452043' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 21:12:48,104 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): master:36465-0x1016ad2d8bb0000, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39587,1689455451998 2023-07-15 21:12:48,106 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): master:36465-0x1016ad2d8bb0000, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39075,1689455452043 2023-07-15 21:12:48,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39587,1689455451998 2023-07-15 21:12:48,104 DEBUG [member: 'jenkins-hbase4.apache.org,39075,1689455452043' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-15 21:12:48,104 DEBUG [member: 'jenkins-hbase4.apache.org,39587,1689455451998' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 21:12:48,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 21:12:48,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 21:12:48,106 DEBUG [member: 'jenkins-hbase4.apache.org,39587,1689455451998' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-15 21:12:48,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 21:12:48,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 21:12:48,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 21:12:48,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39075,1689455452043 2023-07-15 21:12:48,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39587,1689455451998 2023-07-15 21:12:48,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37853,1689455451932 2023-07-15 21:12:48,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 21:12:48,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 21:12:48,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39075,1689455452043 2023-07-15 21:12:48,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39587,1689455451998 2023-07-15 21:12:48,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37853,1689455451932 2023-07-15 21:12:48,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,39587,1689455451998': 2023-07-15 21:12:48,112 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39587,1689455451998' released barrier for procedure'snaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 1 more 2023-07-15 21:12:48,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39075,1689455452043 2023-07-15 21:12:48,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 21:12:48,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 21:12:48,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 21:12:48,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 21:12:48,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 21:12:48,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39075,1689455452043 2023-07-15 21:12:48,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39587,1689455451998 2023-07-15 21:12:48,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37853,1689455451932 2023-07-15 21:12:48,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 21:12:48,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 21:12:48,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39075,1689455452043 2023-07-15 21:12:48,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39587,1689455451998 2023-07-15 21:12:48,115 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37853,1689455451932 2023-07-15 21:12:48,115 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,39075,1689455452043': 2023-07-15 21:12:48,115 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39075,1689455452043' released barrier for procedure'snaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 0 more 2023-07-15 21:12:48,115 INFO [(jenkins-hbase4.apache.org,36465,1689455450507)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' execution completed 2023-07-15 21:12:48,115 DEBUG [(jenkins-hbase4.apache.org,36465,1689455450507)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-15 21:12:48,115 DEBUG [(jenkins-hbase4.apache.org,36465,1689455450507)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-15 21:12:48,115 DEBUG [(jenkins-hbase4.apache.org,36465,1689455450507)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 21:12:48,115 INFO [(jenkins-hbase4.apache.org,36465,1689455450507)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithSkipTmpincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-15 21:12:48,117 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): master:36465-0x1016ad2d8bb0000, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 21:12:48,117 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): regionserver:39587-0x1016ad2d8bb0002, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 21:12:48,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 21:12:48,118 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): regionserver:39075-0x1016ad2d8bb0003, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 21:12:48,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 21:12:48,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 21:12:48,117 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 21:12:48,117 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): regionserver:39587-0x1016ad2d8bb0002, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 21:12:48,117 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): regionserver:37853-0x1016ad2d8bb0001, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 21:12:48,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 21:12:48,118 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 21:12:48,118 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): regionserver:39075-0x1016ad2d8bb0003, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 21:12:48,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 21:12:48,118 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 21:12:48,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 21:12:48,118 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): regionserver:37853-0x1016ad2d8bb0001, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 21:12:48,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 21:12:48,118 DEBUG [(jenkins-hbase4.apache.org,36465,1689455450507)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36465-0x1016ad2d8bb0000, quorum=127.0.0.1:50024, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39075,1689455452043 2023-07-15 21:12:48,118 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 21:12:48,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 21:12:48,119 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 21:12:48,119 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 21:12:48,119 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 21:12:48,119 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 21:12:48,119 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 21:12:48,119 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 21:12:48,119 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 21:12:48,119 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 21:12:48,119 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 21:12:48,119 DEBUG [(jenkins-hbase4.apache.org,36465,1689455450507)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36465-0x1016ad2d8bb0000, quorum=127.0.0.1:50024, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39587,1689455451998 2023-07-15 21:12:48,120 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 21:12:48,120 DEBUG [(jenkins-hbase4.apache.org,36465,1689455450507)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36465-0x1016ad2d8bb0000, quorum=127.0.0.1:50024, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37853,1689455451932 2023-07-15 21:12:48,120 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39075,1689455452043 2023-07-15 21:12:48,121 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39587,1689455451998 2023-07-15 21:12:48,121 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37853,1689455451932 2023-07-15 21:12:48,121 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 21:12:48,122 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 21:12:48,122 DEBUG [(jenkins-hbase4.apache.org,36465,1689455450507)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36465-0x1016ad2d8bb0000, quorum=127.0.0.1:50024, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39075,1689455452043 2023-07-15 21:12:48,122 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39075,1689455452043 2023-07-15 21:12:48,122 DEBUG [(jenkins-hbase4.apache.org,36465,1689455450507)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36465-0x1016ad2d8bb0000, quorum=127.0.0.1:50024, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39587,1689455451998 2023-07-15 21:12:48,122 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39587,1689455451998 2023-07-15 21:12:48,122 DEBUG [(jenkins-hbase4.apache.org,36465,1689455450507)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36465-0x1016ad2d8bb0000, quorum=127.0.0.1:50024, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37853,1689455451932 2023-07-15 21:12:48,123 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37853,1689455451932 2023-07-15 21:12:48,125 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): regionserver:39587-0x1016ad2d8bb0002, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 21:12:48,126 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): regionserver:37853-0x1016ad2d8bb0001, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 21:12:48,126 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): regionserver:37853-0x1016ad2d8bb0001, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 21:12:48,126 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): regionserver:39587-0x1016ad2d8bb0002, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 21:12:48,126 DEBUG [(jenkins-hbase4.apache.org,36465,1689455450507)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 21:12:48,126 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 21:12:48,125 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): master:36465-0x1016ad2d8bb0000, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37853,1689455451932 2023-07-15 21:12:48,128 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithSkipTmp 2023-07-15 21:12:48,129 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => e9516f04c7d2974b21addb190acc6c0a, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,.mob,0.e9516f04c7d2974b21addb190acc6c0a.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 21:12:48,129 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-15 21:12:48,127 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): regionserver:39075-0x1016ad2d8bb0003, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 21:12:48,126 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 21:12:48,129 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 21:12:48,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 21:12:48,126 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 21:12:48,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 21:12:48,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 21:12:48,129 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): regionserver:39075-0x1016ad2d8bb0003, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 21:12:48,128 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): master:36465-0x1016ad2d8bb0000, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 21:12:48,129 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): master:36465-0x1016ad2d8bb0000, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39587,1689455451998 2023-07-15 21:12:48,129 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 21:12:48,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 21:12:48,129 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): master:36465-0x1016ad2d8bb0000, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39075,1689455452043 2023-07-15 21:12:48,130 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): master:36465-0x1016ad2d8bb0000, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 21:12:48,130 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): master:36465-0x1016ad2d8bb0000, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37853,1689455451932 2023-07-15 21:12:48,130 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 21:12:48,130 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 21:12:48,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 21:12:48,130 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): master:36465-0x1016ad2d8bb0000, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 21:12:48,130 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): master:36465-0x1016ad2d8bb0000, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39587,1689455451998 2023-07-15 21:12:48,130 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b20230715a67957b005a14fb1a327a841aaef72b1, hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e202307155dfb0d6480444d81843c70a7f1a79d0a] mob files 2023-07-15 21:12:48,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 21:12:48,130 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b20230715a67957b005a14fb1a327a841aaef72b1 2023-07-15 21:12:48,130 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): master:36465-0x1016ad2d8bb0000, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39075,1689455452043 2023-07-15 21:12:48,130 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e202307155dfb0d6480444d81843c70a7f1a79d0a 2023-07-15 21:12:48,130 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): master:36465-0x1016ad2d8bb0000, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 21:12:48,130 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): master:36465-0x1016ad2d8bb0000, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 21:12:48,140 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 21:12:48,141 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 21:12:48,164 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 21:12:48,191 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed 2023-07-15 21:12:48,191 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 21:12:48,191 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 21:12:48,191 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp at 1689455567900Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithSkipTmp at 1689455568140 (+240 ms)Consolidate snapshot: snaptb0-testExportFileSystemStateWithSkipTmp at 1689455568140Loading Region manifests for snaptb0-testExportFileSystemStateWithSkipTmp at 1689455568140Writing data manifest for snaptb0-testExportFileSystemStateWithSkipTmp at 1689455568143 (+3 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithSkipTmp at 1689455568155 (+12 ms)Snapshot snaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed at 1689455568191 (+36 ms) 2023-07-15 21:12:48,194 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=113, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-15 21:12:48,196 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=113, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED in 293 msec 2023-07-15 21:12:48,204 DEBUG [Listener at jenkins-hbase4.apache.org/41711] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-15 21:12:48,205 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36465] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-15 21:12:48,205 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36465] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-15 21:12:48,205 INFO [Listener at jenkins-hbase4.apache.org/41711] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/export-test/export-1689455568205 2023-07-15 21:12:48,206 INFO [Listener at jenkins-hbase4.apache.org/41711] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:46859, tgtDir=hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/export-test/export-1689455568205, rawTgtDir=hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/export-test/export-1689455568205, srcFsUri=hdfs://localhost:46859, srcDir=hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313 2023-07-15 21:12:48,235 DEBUG [Listener at jenkins-hbase4.apache.org/41711] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:46859, inputRoot=hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313 2023-07-15 21:12:48,235 DEBUG [Listener at jenkins-hbase4.apache.org/41711] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1547478621_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/export-test/export-1689455568205, skipTmp=true, initialOutputSnapshotDir=hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/export-test/export-1689455568205/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 21:12:48,235 INFO [Listener at jenkins-hbase4.apache.org/41711] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:46859, inputRoot=hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313, snapshotDir=hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp. 2023-07-15 21:12:48,249 INFO [Listener at jenkins-hbase4.apache.org/41711] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/export-test/export-1689455568205/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 21:12:48,286 DEBUG [Listener at jenkins-hbase4.apache.org/41711] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-15 21:12:48,287 DEBUG [Listener at jenkins-hbase4.apache.org/41711] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-15 21:12:48,287 DEBUG [Listener at jenkins-hbase4.apache.org/41711] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-15 21:12:48,287 DEBUG [Listener at jenkins-hbase4.apache.org/41711] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-15 21:12:48,288 DEBUG [Listener at jenkins-hbase4.apache.org/41711] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-15 21:12:48,288 DEBUG [Listener at jenkins-hbase4.apache.org/41711] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-15 21:12:48,288 DEBUG [Listener at jenkins-hbase4.apache.org/41711] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-15 21:12:48,376 DEBUG [Listener at jenkins-hbase4.apache.org/41711] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/de3e87f0-08fc-c0d0-c969-4c410fd4e6fd/hadoop-6488518705235394652.jar 2023-07-15 21:12:48,377 DEBUG [Listener at jenkins-hbase4.apache.org/41711] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-15 21:12:48,377 DEBUG [Listener at jenkins-hbase4.apache.org/41711] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-15 21:12:48,377 DEBUG [Listener at jenkins-hbase4.apache.org/41711] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-15 21:12:48,378 DEBUG [Listener at jenkins-hbase4.apache.org/41711] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-15 21:12:48,378 DEBUG [Listener at jenkins-hbase4.apache.org/41711] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-15 21:12:48,378 DEBUG [Listener at jenkins-hbase4.apache.org/41711] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-15 21:12:48,379 DEBUG [Listener at jenkins-hbase4.apache.org/41711] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-15 21:12:48,379 DEBUG [Listener at jenkins-hbase4.apache.org/41711] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-15 21:12:48,380 DEBUG [Listener at jenkins-hbase4.apache.org/41711] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-15 21:12:48,380 DEBUG [Listener at jenkins-hbase4.apache.org/41711] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-15 21:12:48,380 DEBUG [Listener at jenkins-hbase4.apache.org/41711] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-15 21:12:48,381 DEBUG [Listener at jenkins-hbase4.apache.org/41711] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-15 21:12:48,381 DEBUG [Listener at jenkins-hbase4.apache.org/41711] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-15 21:12:48,382 DEBUG [Listener at jenkins-hbase4.apache.org/41711] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-15 21:12:48,382 DEBUG [Listener at jenkins-hbase4.apache.org/41711] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-15 21:12:48,383 DEBUG [Listener at jenkins-hbase4.apache.org/41711] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-15 21:12:48,383 DEBUG [Listener at jenkins-hbase4.apache.org/41711] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-15 21:12:48,384 DEBUG [Listener at jenkins-hbase4.apache.org/41711] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-15 21:12:48,384 DEBUG [Listener at jenkins-hbase4.apache.org/41711] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-15 21:12:48,384 DEBUG [Listener at jenkins-hbase4.apache.org/41711] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-15 21:12:48,384 DEBUG [Listener at jenkins-hbase4.apache.org/41711] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-15 21:12:48,385 DEBUG [Listener at jenkins-hbase4.apache.org/41711] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-15 21:12:48,385 DEBUG [Listener at jenkins-hbase4.apache.org/41711] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-15 21:12:50,050 WARN [Listener at jenkins-hbase4.apache.org/41711] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-15 21:12:50,053 INFO [Listener at jenkins-hbase4.apache.org/41711] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemStateWithSkipTmp' hfile list 2023-07-15 21:12:50,055 DEBUG [Listener at jenkins-hbase4.apache.org/41711] snapshot.ExportSnapshot(671): export split=0 size=31.5 K 2023-07-15 21:12:51,021 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-15 21:12:51,021 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-15 21:12:51,042 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689455459463_0006_000001 (auth:SIMPLE) 2023-07-15 21:12:51,370 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689455459463_0007_000001 (auth:SIMPLE) 2023-07-15 21:12:51,841 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-15 21:12:56,988 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689455459463_0007_000001 (auth:SIMPLE) 2023-07-15 21:12:59,279 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689455459463_0007_000001 (auth:SIMPLE) 2023-07-15 21:13:03,477 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689455459463_0007_000001 (auth:SIMPLE) 2023-07-15 21:13:05,321 INFO [Listener at jenkins-hbase4.apache.org/41711] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-15 21:13:05,321 INFO [Listener at jenkins-hbase4.apache.org/41711] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-15 21:13:05,355 INFO [Listener at jenkins-hbase4.apache.org/41711] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 21:13:05,356 INFO [Listener at jenkins-hbase4.apache.org/41711] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-15 21:13:05,356 INFO [Listener at jenkins-hbase4.apache.org/41711] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-15 21:13:05,356 DEBUG [Listener at jenkins-hbase4.apache.org/41711] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1600112846_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp at hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 21:13:05,357 DEBUG [Listener at jenkins-hbase4.apache.org/41711] snapshot.TestExportSnapshot(367): hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/.snapshotinfo 2023-07-15 21:13:05,357 DEBUG [Listener at jenkins-hbase4.apache.org/41711] snapshot.TestExportSnapshot(367): hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/data.manifest 2023-07-15 21:13:05,357 DEBUG [Listener at jenkins-hbase4.apache.org/41711] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1600112846_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/export-test/export-1689455568205/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp at hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/export-test/export-1689455568205/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 21:13:05,358 DEBUG [Listener at jenkins-hbase4.apache.org/41711] snapshot.TestExportSnapshot(367): hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/export-test/export-1689455568205/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/.snapshotinfo 2023-07-15 21:13:05,358 DEBUG [Listener at jenkins-hbase4.apache.org/41711] snapshot.TestExportSnapshot(367): hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/export-test/export-1689455568205/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/data.manifest 2023-07-15 21:13:05,387 INFO [Listener at jenkins-hbase4.apache.org/41711] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithSkipTmp 2023-07-15 21:13:05,387 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36465] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemStateWithSkipTmp 2023-07-15 21:13:05,388 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36465] procedure2.ProcedureExecutor(1029): Stored pid=114, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-15 21:13:05,394 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36465] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-07-15 21:13:05,396 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689455585396"}]},"ts":"1689455585396"} 2023-07-15 21:13:05,398 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=DISABLING in hbase:meta 2023-07-15 21:13:05,400 INFO [PEWorker-2] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithSkipTmp to state=DISABLING 2023-07-15 21:13:05,400 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=115, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=106264d98f4159c78cc8f13df7eabf30, UNASSIGN}, {pid=116, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=adb292f49877fba2e1d2c5f9b3cec3ec, UNASSIGN}] 2023-07-15 21:13:05,403 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=115, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=106264d98f4159c78cc8f13df7eabf30, UNASSIGN 2023-07-15 21:13:05,403 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=116, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=adb292f49877fba2e1d2c5f9b3cec3ec, UNASSIGN 2023-07-15 21:13:05,403 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=115 updating hbase:meta row=106264d98f4159c78cc8f13df7eabf30, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,39075,1689455452043 2023-07-15 21:13:05,403 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=116 updating hbase:meta row=adb292f49877fba2e1d2c5f9b3cec3ec, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,39587,1689455451998 2023-07-15 21:13:05,404 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689455566525.adb292f49877fba2e1d2c5f9b3cec3ec.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689455585403"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689455585403"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689455585403"}]},"ts":"1689455585403"} 2023-07-15 21:13:05,404 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689455566525.106264d98f4159c78cc8f13df7eabf30.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689455585403"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689455585403"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689455585403"}]},"ts":"1689455585403"} 2023-07-15 21:13:05,406 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=117, ppid=116, state=RUNNABLE; CloseRegionProcedure adb292f49877fba2e1d2c5f9b3cec3ec, server=jenkins-hbase4.apache.org,39587,1689455451998}] 2023-07-15 21:13:05,407 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=118, ppid=115, state=RUNNABLE; CloseRegionProcedure 106264d98f4159c78cc8f13df7eabf30, server=jenkins-hbase4.apache.org,39075,1689455452043}] 2023-07-15 21:13:05,496 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36465] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-07-15 21:13:05,559 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close adb292f49877fba2e1d2c5f9b3cec3ec 2023-07-15 21:13:05,559 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing adb292f49877fba2e1d2c5f9b3cec3ec, disabling compactions & flushes 2023-07-15 21:13:05,559 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,1,1689455566525.adb292f49877fba2e1d2c5f9b3cec3ec. 2023-07-15 21:13:05,559 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1689455566525.adb292f49877fba2e1d2c5f9b3cec3ec. 2023-07-15 21:13:05,559 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1689455566525.adb292f49877fba2e1d2c5f9b3cec3ec. after waiting 0 ms 2023-07-15 21:13:05,559 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,1,1689455566525.adb292f49877fba2e1d2c5f9b3cec3ec. 2023-07-15 21:13:05,560 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 106264d98f4159c78cc8f13df7eabf30 2023-07-15 21:13:05,560 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 106264d98f4159c78cc8f13df7eabf30, disabling compactions & flushes 2023-07-15 21:13:05,560 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,,1689455566525.106264d98f4159c78cc8f13df7eabf30. 2023-07-15 21:13:05,560 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,,1689455566525.106264d98f4159c78cc8f13df7eabf30. 2023-07-15 21:13:05,560 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,,1689455566525.106264d98f4159c78cc8f13df7eabf30. after waiting 0 ms 2023-07-15 21:13:05,560 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,,1689455566525.106264d98f4159c78cc8f13df7eabf30. 2023-07-15 21:13:05,615 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/data/default/testtb-testExportFileSystemStateWithSkipTmp/adb292f49877fba2e1d2c5f9b3cec3ec/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-15 21:13:05,616 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-15 21:13:05,617 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,1,1689455566525.adb292f49877fba2e1d2c5f9b3cec3ec. 2023-07-15 21:13:05,617 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for adb292f49877fba2e1d2c5f9b3cec3ec: 2023-07-15 21:13:05,618 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/data/default/testtb-testExportFileSystemStateWithSkipTmp/106264d98f4159c78cc8f13df7eabf30/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-15 21:13:05,619 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-15 21:13:05,620 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,,1689455566525.106264d98f4159c78cc8f13df7eabf30. 2023-07-15 21:13:05,620 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 106264d98f4159c78cc8f13df7eabf30: 2023-07-15 21:13:05,620 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed adb292f49877fba2e1d2c5f9b3cec3ec 2023-07-15 21:13:05,626 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=116 updating hbase:meta row=adb292f49877fba2e1d2c5f9b3cec3ec, regionState=CLOSED 2023-07-15 21:13:05,626 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689455566525.adb292f49877fba2e1d2c5f9b3cec3ec.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689455585626"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689455585626"}]},"ts":"1689455585626"} 2023-07-15 21:13:05,626 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 106264d98f4159c78cc8f13df7eabf30 2023-07-15 21:13:05,627 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=115 updating hbase:meta row=106264d98f4159c78cc8f13df7eabf30, regionState=CLOSED 2023-07-15 21:13:05,627 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689455566525.106264d98f4159c78cc8f13df7eabf30.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689455585627"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689455585627"}]},"ts":"1689455585627"} 2023-07-15 21:13:05,633 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=118, resume processing ppid=115 2023-07-15 21:13:05,633 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=117, resume processing ppid=116 2023-07-15 21:13:05,633 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=118, ppid=115, state=SUCCESS; CloseRegionProcedure 106264d98f4159c78cc8f13df7eabf30, server=jenkins-hbase4.apache.org,39075,1689455452043 in 223 msec 2023-07-15 21:13:05,633 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=117, ppid=116, state=SUCCESS; CloseRegionProcedure adb292f49877fba2e1d2c5f9b3cec3ec, server=jenkins-hbase4.apache.org,39587,1689455451998 in 223 msec 2023-07-15 21:13:05,635 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=116, ppid=114, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=adb292f49877fba2e1d2c5f9b3cec3ec, UNASSIGN in 233 msec 2023-07-15 21:13:05,636 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=115, resume processing ppid=114 2023-07-15 21:13:05,636 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=115, ppid=114, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=106264d98f4159c78cc8f13df7eabf30, UNASSIGN in 233 msec 2023-07-15 21:13:05,637 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689455585637"}]},"ts":"1689455585637"} 2023-07-15 21:13:05,638 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=DISABLED in hbase:meta 2023-07-15 21:13:05,640 INFO [PEWorker-2] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithSkipTmp to state=DISABLED 2023-07-15 21:13:05,643 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=114, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 254 msec 2023-07-15 21:13:05,697 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36465] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-07-15 21:13:05,697 INFO [Listener at jenkins-hbase4.apache.org/41711] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 114 completed 2023-07-15 21:13:05,698 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36465] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemStateWithSkipTmp 2023-07-15 21:13:05,698 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36465] procedure2.ProcedureExecutor(1029): Stored pid=119, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-15 21:13:05,701 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=119, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-15 21:13:05,701 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36465] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithSkipTmp 2023-07-15 21:13:05,702 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=119, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-15 21:13:05,703 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=39075] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithSkipTmp 2023-07-15 21:13:05,707 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): regionserver:39075-0x1016ad2d8bb0003, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-15 21:13:05,707 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): regionserver:39587-0x1016ad2d8bb0002, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-15 21:13:05,707 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): regionserver:37853-0x1016ad2d8bb0001, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-15 21:13:05,707 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): master:36465-0x1016ad2d8bb0000, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-15 21:13:05,707 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-07-15 21:13:05,707 DEBUG [HFileArchiver-23] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/adb292f49877fba2e1d2c5f9b3cec3ec 2023-07-15 21:13:05,707 DEBUG [HFileArchiver-22] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/106264d98f4159c78cc8f13df7eabf30 2023-07-15 21:13:05,708 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-07-15 21:13:05,708 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-07-15 21:13:05,710 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): master:36465-0x1016ad2d8bb0000, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 21:13:05,710 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): regionserver:39075-0x1016ad2d8bb0003, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-15 21:13:05,710 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data null 2023-07-15 21:13:05,710 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-15 21:13:05,710 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): regionserver:37853-0x1016ad2d8bb0001, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-15 21:13:05,710 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): regionserver:39075-0x1016ad2d8bb0003, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 21:13:05,710 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): regionserver:39587-0x1016ad2d8bb0002, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-15 21:13:05,710 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): regionserver:37853-0x1016ad2d8bb0001, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 21:13:05,710 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): regionserver:39587-0x1016ad2d8bb0002, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 21:13:05,710 DEBUG [HFileArchiver-23] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/adb292f49877fba2e1d2c5f9b3cec3ec/cf, FileablePath, hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/adb292f49877fba2e1d2c5f9b3cec3ec/recovered.edits] 2023-07-15 21:13:05,711 DEBUG [HFileArchiver-22] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/106264d98f4159c78cc8f13df7eabf30/cf, FileablePath, hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/106264d98f4159c78cc8f13df7eabf30/recovered.edits] 2023-07-15 21:13:05,711 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36465] master.MasterRpcServices(1230): Checking to see if procedure is done pid=119 2023-07-15 21:13:05,716 DEBUG [HFileArchiver-22] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/106264d98f4159c78cc8f13df7eabf30/cf/56f6c373cbe94524913f410cba6f9b50 to hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/106264d98f4159c78cc8f13df7eabf30/cf/56f6c373cbe94524913f410cba6f9b50 2023-07-15 21:13:05,716 DEBUG [HFileArchiver-23] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/adb292f49877fba2e1d2c5f9b3cec3ec/cf/baa7671450954e51aff1a55ebd91ee0e to hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/adb292f49877fba2e1d2c5f9b3cec3ec/cf/baa7671450954e51aff1a55ebd91ee0e 2023-07-15 21:13:05,720 DEBUG [HFileArchiver-22] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/106264d98f4159c78cc8f13df7eabf30/recovered.edits/9.seqid to hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/106264d98f4159c78cc8f13df7eabf30/recovered.edits/9.seqid 2023-07-15 21:13:05,720 DEBUG [HFileArchiver-23] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/adb292f49877fba2e1d2c5f9b3cec3ec/recovered.edits/9.seqid to hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/adb292f49877fba2e1d2c5f9b3cec3ec/recovered.edits/9.seqid 2023-07-15 21:13:05,720 DEBUG [HFileArchiver-22] backup.HFileArchiver(596): Deleted hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/106264d98f4159c78cc8f13df7eabf30 2023-07-15 21:13:05,721 DEBUG [HFileArchiver-23] backup.HFileArchiver(596): Deleted hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/adb292f49877fba2e1d2c5f9b3cec3ec 2023-07-15 21:13:05,721 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithSkipTmp regions 2023-07-15 21:13:05,721 DEBUG [PEWorker-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a 2023-07-15 21:13:05,722 DEBUG [PEWorker-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf] 2023-07-15 21:13:05,726 DEBUG [PEWorker-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b20230715a67957b005a14fb1a327a841aaef72b1 to hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b20230715a67957b005a14fb1a327a841aaef72b1 2023-07-15 21:13:05,730 DEBUG [PEWorker-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e202307155dfb0d6480444d81843c70a7f1a79d0a to hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e202307155dfb0d6480444d81843c70a7f1a79d0a 2023-07-15 21:13:05,731 DEBUG [PEWorker-5] backup.HFileArchiver(596): Deleted hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a 2023-07-15 21:13:05,733 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=119, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-15 21:13:05,736 WARN [PEWorker-5] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemStateWithSkipTmp from hbase:meta 2023-07-15 21:13:05,749 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithSkipTmp' descriptor. 2023-07-15 21:13:05,750 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=119, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-15 21:13:05,750 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithSkipTmp' from region states. 2023-07-15 21:13:05,751 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689455566525.106264d98f4159c78cc8f13df7eabf30.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689455585750"}]},"ts":"9223372036854775807"} 2023-07-15 21:13:05,751 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689455566525.adb292f49877fba2e1d2c5f9b3cec3ec.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689455585750"}]},"ts":"9223372036854775807"} 2023-07-15 21:13:05,753 INFO [PEWorker-5] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-15 21:13:05,753 DEBUG [PEWorker-5] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 106264d98f4159c78cc8f13df7eabf30, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1689455566525.106264d98f4159c78cc8f13df7eabf30.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => adb292f49877fba2e1d2c5f9b3cec3ec, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1689455566525.adb292f49877fba2e1d2c5f9b3cec3ec.', STARTKEY => '1', ENDKEY => ''}] 2023-07-15 21:13:05,753 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithSkipTmp' as deleted. 2023-07-15 21:13:05,753 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689455585753"}]},"ts":"9223372036854775807"} 2023-07-15 21:13:05,755 INFO [PEWorker-5] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithSkipTmp state from META 2023-07-15 21:13:05,757 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(130): Finished pid=119, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-15 21:13:05,758 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=119, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 59 msec 2023-07-15 21:13:05,813 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36465] master.MasterRpcServices(1230): Checking to see if procedure is done pid=119 2023-07-15 21:13:05,813 INFO [Listener at jenkins-hbase4.apache.org/41711] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 119 completed 2023-07-15 21:13:05,822 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36465] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportFileSystemStateWithSkipTmp" 2023-07-15 21:13:05,826 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36465] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 21:13:05,827 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36465] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemStateWithSkipTmp" 2023-07-15 21:13:05,829 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36465] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 21:13:05,862 INFO [Listener at jenkins-hbase4.apache.org/41711] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithSkipTmp Thread=762 (was 761) Potentially hanging thread: ContainersLauncher #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x401a2f8d-shared-pool-40 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1600112846_17 at /127.0.0.1:58220 [Waiting for operation #6] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x401a2f8d-shared-pool-41 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-533051714_1 at /127.0.0.1:58174 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-23 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (2038956992) connection to jenkins-hbase4.apache.org/172.31.14.131:43325 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: ApplicationMasterLauncher #12 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1600112846_17 at /127.0.0.1:50428 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Parameter Sending Thread #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #11 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x401a2f8d-shared-pool-42 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x401a2f8d-shared-pool-43 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1600112846_17 at /127.0.0.1:34876 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-22 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-5550 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=899 (was 921), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=601 (was 550) - SystemLoadAverage LEAK? -, ProcessCount=182 (was 182), AvailableMemoryMB=1640 (was 1893) 2023-07-15 21:13:05,863 WARN [Listener at jenkins-hbase4.apache.org/41711] hbase.ResourceChecker(130): Thread=762 is superior to 500 2023-07-15 21:13:05,863 INFO [Listener at jenkins-hbase4.apache.org/41711] hbase.HBaseTestingUtility(2762): Stopping mini mapreduce cluster... 2023-07-15 21:13:05,894 INFO [Listener at jenkins-hbase4.apache.org/41711] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-07-15 21:13:09,581 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689455459463_0007_000001 (auth:SIMPLE) 2023-07-15 21:13:11,197 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-15 21:13:19,947 INFO [Listener at jenkins-hbase4.apache.org/41711] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-07-15 21:13:34,068 ERROR [Thread[Thread-410,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-07-15 21:13:34,069 INFO [Listener at jenkins-hbase4.apache.org/41711] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-07-15 21:13:34,188 WARN [ApplicationMaster Launcher] amlauncher.ApplicationMasterLauncher$LauncherThread(122): org.apache.hadoop.yarn.server.resourcemanager.amlauncher.ApplicationMasterLauncher$LauncherThread interrupted. Returning. 2023-07-15 21:13:34,205 ERROR [SchedulerEventDispatcher:Event Processor] event.EventDispatcher$EventProcessor(61): Returning, interrupted : java.lang.InterruptedException 2023-07-15 21:13:34,206 ERROR [Thread[Thread-420,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-07-15 21:13:34,221 INFO [Listener at jenkins-hbase4.apache.org/41711] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-07-15 21:13:34,325 ERROR [Thread[Thread-385,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-07-15 21:13:34,325 INFO [Listener at jenkins-hbase4.apache.org/41711] hbase.HBaseTestingUtility(2765): Mini mapreduce cluster stopped 2023-07-15 21:13:34,325 INFO [Listener at jenkins-hbase4.apache.org/41711] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-07-15 21:13:34,326 INFO [Listener at jenkins-hbase4.apache.org/41711] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-07-15 21:13:34,326 DEBUG [Listener at jenkins-hbase4.apache.org/41711] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0a248d85 to 127.0.0.1:50024 2023-07-15 21:13:34,326 DEBUG [Listener at jenkins-hbase4.apache.org/41711] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-15 21:13:34,326 DEBUG [Listener at jenkins-hbase4.apache.org/41711] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-07-15 21:13:34,326 DEBUG [Listener at jenkins-hbase4.apache.org/41711] util.JVMClusterUtil(257): Found active master hash=133053515, stopped=false 2023-07-15 21:13:34,326 DEBUG [Listener at jenkins-hbase4.apache.org/41711] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-15 21:13:34,326 DEBUG [Listener at jenkins-hbase4.apache.org/41711] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver 2023-07-15 21:13:34,326 INFO [Listener at jenkins-hbase4.apache.org/41711] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase4.apache.org,36465,1689455450507 2023-07-15 21:13:34,330 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): master:36465-0x1016ad2d8bb0000, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-15 21:13:34,330 INFO [Listener at jenkins-hbase4.apache.org/41711] procedure2.ProcedureExecutor(629): Stopping 2023-07-15 21:13:34,330 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): regionserver:39587-0x1016ad2d8bb0002, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-15 21:13:34,330 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): regionserver:39075-0x1016ad2d8bb0003, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-15 21:13:34,330 DEBUG [Listener at jenkins-hbase4.apache.org/41711] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x415ecc31 to 127.0.0.1:50024 2023-07-15 21:13:34,330 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): regionserver:37853-0x1016ad2d8bb0001, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-15 21:13:34,330 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): master:36465-0x1016ad2d8bb0000, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-15 21:13:34,331 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39075-0x1016ad2d8bb0003, quorum=127.0.0.1:50024, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-15 21:13:34,331 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37853-0x1016ad2d8bb0001, quorum=127.0.0.1:50024, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-15 21:13:34,331 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:36465-0x1016ad2d8bb0000, quorum=127.0.0.1:50024, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-15 21:13:34,331 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39587-0x1016ad2d8bb0002, quorum=127.0.0.1:50024, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-15 21:13:34,330 DEBUG [Listener at jenkins-hbase4.apache.org/41711] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-15 21:13:34,332 INFO [Listener at jenkins-hbase4.apache.org/41711] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,37853,1689455451932' ***** 2023-07-15 21:13:34,332 DEBUG [Listener at jenkins-hbase4.apache.org/41711] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-15 21:13:34,332 INFO [Listener at jenkins-hbase4.apache.org/41711] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-07-15 21:13:34,332 INFO [Listener at jenkins-hbase4.apache.org/41711] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,39587,1689455451998' ***** 2023-07-15 21:13:34,332 DEBUG [Listener at jenkins-hbase4.apache.org/41711] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-15 21:13:34,332 INFO [Listener at jenkins-hbase4.apache.org/41711] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-07-15 21:13:34,332 INFO [Listener at jenkins-hbase4.apache.org/41711] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,39075,1689455452043' ***** 2023-07-15 21:13:34,332 DEBUG [Listener at jenkins-hbase4.apache.org/41711] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-15 21:13:34,332 INFO [RS:0;jenkins-hbase4:37853] regionserver.HeapMemoryManager(220): Stopping 2023-07-15 21:13:34,332 INFO [Listener at jenkins-hbase4.apache.org/41711] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-07-15 21:13:34,332 INFO [RS:1;jenkins-hbase4:39587] regionserver.HeapMemoryManager(220): Stopping 2023-07-15 21:13:34,333 INFO [RS:2;jenkins-hbase4:39075] regionserver.HeapMemoryManager(220): Stopping 2023-07-15 21:13:34,333 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-07-15 21:13:34,333 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-07-15 21:13:34,333 INFO [RS:0;jenkins-hbase4:37853] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-07-15 21:13:34,333 INFO [RS:2;jenkins-hbase4:39075] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-07-15 21:13:34,333 INFO [RS:0;jenkins-hbase4:37853] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-07-15 21:13:34,333 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-07-15 21:13:34,333 INFO [RS:1;jenkins-hbase4:39587] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-07-15 21:13:34,333 INFO [RS:0;jenkins-hbase4:37853] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,37853,1689455451932 2023-07-15 21:13:34,333 INFO [RS:2;jenkins-hbase4:39075] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-07-15 21:13:34,333 DEBUG [RS:0;jenkins-hbase4:37853] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x51e12de0 to 127.0.0.1:50024 2023-07-15 21:13:34,333 DEBUG [RS:0;jenkins-hbase4:37853] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-15 21:13:34,333 INFO [RS:1;jenkins-hbase4:39587] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-07-15 21:13:34,336 INFO [RS:1;jenkins-hbase4:39587] regionserver.HRegionServer(3305): Received CLOSE for 1b0dd1d2541fcb6773c416eff63248c3 2023-07-15 21:13:34,336 INFO [RS:1;jenkins-hbase4:39587] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,39587,1689455451998 2023-07-15 21:13:34,336 DEBUG [RS:1;jenkins-hbase4:39587] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3a45c34a to 127.0.0.1:50024 2023-07-15 21:13:34,336 DEBUG [RS:1;jenkins-hbase4:39587] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-15 21:13:34,335 INFO [RS:2;jenkins-hbase4:39075] regionserver.HRegionServer(3305): Received CLOSE for 53946c1aed1c923485e0abe3a27a9e59 2023-07-15 21:13:34,335 INFO [RS:0;jenkins-hbase4:37853] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,37853,1689455451932; all regions closed. 2023-07-15 21:13:34,339 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 1b0dd1d2541fcb6773c416eff63248c3, disabling compactions & flushes 2023-07-15 21:13:34,338 INFO [RS:2;jenkins-hbase4:39075] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,39075,1689455452043 2023-07-15 21:13:34,339 DEBUG [RS:2;jenkins-hbase4:39075] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2ea9302f to 127.0.0.1:50024 2023-07-15 21:13:34,339 DEBUG [RS:2;jenkins-hbase4:39075] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-15 21:13:34,338 INFO [RS:1;jenkins-hbase4:39587] regionserver.HRegionServer(1474): Waiting on 1 regions to close 2023-07-15 21:13:34,339 DEBUG [RS:1;jenkins-hbase4:39587] regionserver.HRegionServer(1478): Online Regions={1b0dd1d2541fcb6773c416eff63248c3=hbase:namespace,,1689455454829.1b0dd1d2541fcb6773c416eff63248c3.} 2023-07-15 21:13:34,340 DEBUG [RS:1;jenkins-hbase4:39587] regionserver.HRegionServer(1504): Waiting on 1b0dd1d2541fcb6773c416eff63248c3 2023-07-15 21:13:34,343 INFO [RS:2;jenkins-hbase4:39075] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-07-15 21:13:34,343 INFO [RS:2;jenkins-hbase4:39075] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-07-15 21:13:34,343 INFO [RS:2;jenkins-hbase4:39075] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-07-15 21:13:34,343 INFO [RS:2;jenkins-hbase4:39075] regionserver.HRegionServer(3305): Received CLOSE for 1588230740 2023-07-15 21:13:34,339 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1689455454829.1b0dd1d2541fcb6773c416eff63248c3. 2023-07-15 21:13:34,344 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 53946c1aed1c923485e0abe3a27a9e59, disabling compactions & flushes 2023-07-15 21:13:34,344 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1689455454829.1b0dd1d2541fcb6773c416eff63248c3. 2023-07-15 21:13:34,344 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:acl,,1689455455584.53946c1aed1c923485e0abe3a27a9e59. 2023-07-15 21:13:34,344 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1689455454829.1b0dd1d2541fcb6773c416eff63248c3. after waiting 0 ms 2023-07-15 21:13:34,344 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1689455454829.1b0dd1d2541fcb6773c416eff63248c3. 2023-07-15 21:13:34,344 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:acl,,1689455455584.53946c1aed1c923485e0abe3a27a9e59. 2023-07-15 21:13:34,344 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:acl,,1689455455584.53946c1aed1c923485e0abe3a27a9e59. after waiting 0 ms 2023-07-15 21:13:34,344 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 1b0dd1d2541fcb6773c416eff63248c3 1/1 column families, dataSize=78 B heapSize=488 B 2023-07-15 21:13:34,344 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:acl,,1689455455584.53946c1aed1c923485e0abe3a27a9e59. 2023-07-15 21:13:34,344 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 53946c1aed1c923485e0abe3a27a9e59 1/1 column families, dataSize=914 B heapSize=2.17 KB 2023-07-15 21:13:34,346 INFO [RS:2;jenkins-hbase4:39075] regionserver.HRegionServer(1474): Waiting on 2 regions to close 2023-07-15 21:13:34,355 DEBUG [RS:2;jenkins-hbase4:39075] regionserver.HRegionServer(1478): Online Regions={53946c1aed1c923485e0abe3a27a9e59=hbase:acl,,1689455455584.53946c1aed1c923485e0abe3a27a9e59., 1588230740=hbase:meta,,1.1588230740} 2023-07-15 21:13:34,355 DEBUG [RS:2;jenkins-hbase4:39075] regionserver.HRegionServer(1504): Waiting on 1588230740, 53946c1aed1c923485e0abe3a27a9e59 2023-07-15 21:13:34,360 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-07-15 21:13:34,360 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-07-15 21:13:34,360 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-07-15 21:13:34,360 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-07-15 21:13:34,360 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-07-15 21:13:34,360 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 1588230740 3/3 column families, dataSize=45.93 KB heapSize=71.92 KB 2023-07-15 21:13:34,382 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-07-15 21:13:34,392 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-07-15 21:13:34,396 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-07-15 21:13:34,474 DEBUG [RS:0;jenkins-hbase4:37853] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/oldWALs 2023-07-15 21:13:34,474 INFO [RS:0;jenkins-hbase4:37853] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C37853%2C1689455451932:(num 1689455454238) 2023-07-15 21:13:34,474 DEBUG [RS:0;jenkins-hbase4:37853] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-15 21:13:34,474 INFO [RS:0;jenkins-hbase4:37853] regionserver.LeaseManager(133): Closed leases 2023-07-15 21:13:34,475 INFO [RS:0;jenkins-hbase4:37853] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-07-15 21:13:34,476 INFO [RS:0;jenkins-hbase4:37853] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-07-15 21:13:34,477 INFO [RS:0;jenkins-hbase4:37853] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-07-15 21:13:34,477 INFO [RS:0;jenkins-hbase4:37853] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-07-15 21:13:34,477 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-15 21:13:34,478 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=914 B at sequenceid=18 (bloomFilter=false), to=hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/data/hbase/acl/53946c1aed1c923485e0abe3a27a9e59/.tmp/l/12f67d1601de441a8b71afca61c22662 2023-07-15 21:13:34,479 INFO [RS:0;jenkins-hbase4:37853] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:37853 2023-07-15 21:13:34,485 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): regionserver:39587-0x1016ad2d8bb0002, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,37853,1689455451932 2023-07-15 21:13:34,485 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): regionserver:37853-0x1016ad2d8bb0001, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,37853,1689455451932 2023-07-15 21:13:34,486 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): regionserver:37853-0x1016ad2d8bb0001, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-15 21:13:34,485 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): regionserver:39075-0x1016ad2d8bb0003, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,37853,1689455451932 2023-07-15 21:13:34,485 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): regionserver:39587-0x1016ad2d8bb0002, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-15 21:13:34,486 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): regionserver:39075-0x1016ad2d8bb0003, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-15 21:13:34,487 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=40.45 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/data/hbase/meta/1588230740/.tmp/info/0e789dabcfab48afb6daa9c2330181c8 2023-07-15 21:13:34,487 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): master:36465-0x1016ad2d8bb0000, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-15 21:13:34,490 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/data/hbase/namespace/1b0dd1d2541fcb6773c416eff63248c3/.tmp/info/2c483bdf565242d8926e62fa9ab85e38 2023-07-15 21:13:34,490 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,37853,1689455451932] 2023-07-15 21:13:34,491 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,37853,1689455451932; numProcessing=1 2023-07-15 21:13:34,493 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 12f67d1601de441a8b71afca61c22662 2023-07-15 21:13:34,493 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,37853,1689455451932 already deleted, retry=false 2023-07-15 21:13:34,493 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,37853,1689455451932 expired; onlineServers=2 2023-07-15 21:13:34,494 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/data/hbase/acl/53946c1aed1c923485e0abe3a27a9e59/.tmp/l/12f67d1601de441a8b71afca61c22662 as hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/data/hbase/acl/53946c1aed1c923485e0abe3a27a9e59/l/12f67d1601de441a8b71afca61c22662 2023-07-15 21:13:34,496 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 0e789dabcfab48afb6daa9c2330181c8 2023-07-15 21:13:34,509 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/data/hbase/namespace/1b0dd1d2541fcb6773c416eff63248c3/.tmp/info/2c483bdf565242d8926e62fa9ab85e38 as hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/data/hbase/namespace/1b0dd1d2541fcb6773c416eff63248c3/info/2c483bdf565242d8926e62fa9ab85e38 2023-07-15 21:13:34,514 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 12f67d1601de441a8b71afca61c22662 2023-07-15 21:13:34,514 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/data/hbase/acl/53946c1aed1c923485e0abe3a27a9e59/l/12f67d1601de441a8b71afca61c22662, entries=7, sequenceid=18, filesize=5.2 K 2023-07-15 21:13:34,515 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~914 B/914, heapSize ~2.16 KB/2208, currentSize=0 B/0 for 53946c1aed1c923485e0abe3a27a9e59 in 171ms, sequenceid=18, compaction requested=false 2023-07-15 21:13:34,530 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/data/hbase/namespace/1b0dd1d2541fcb6773c416eff63248c3/info/2c483bdf565242d8926e62fa9ab85e38, entries=2, sequenceid=6, filesize=4.8 K 2023-07-15 21:13:34,534 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/data/hbase/acl/53946c1aed1c923485e0abe3a27a9e59/recovered.edits/21.seqid, newMaxSeqId=21, maxSeqId=1 2023-07-15 21:13:34,536 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-15 21:13:34,536 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for 1b0dd1d2541fcb6773c416eff63248c3 in 192ms, sequenceid=6, compaction requested=false 2023-07-15 21:13:34,537 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:acl,,1689455455584.53946c1aed1c923485e0abe3a27a9e59. 2023-07-15 21:13:34,537 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 53946c1aed1c923485e0abe3a27a9e59: 2023-07-15 21:13:34,537 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:acl,,1689455455584.53946c1aed1c923485e0abe3a27a9e59. 2023-07-15 21:13:34,538 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=1.50 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/data/hbase/meta/1588230740/.tmp/rep_barrier/ab356a1faa7849ac93eee0c21fcbc92a 2023-07-15 21:13:34,541 DEBUG [RS:1;jenkins-hbase4:39587] regionserver.HRegionServer(1504): Waiting on 1b0dd1d2541fcb6773c416eff63248c3 2023-07-15 21:13:34,543 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for ab356a1faa7849ac93eee0c21fcbc92a 2023-07-15 21:13:34,549 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/data/hbase/namespace/1b0dd1d2541fcb6773c416eff63248c3/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-15 21:13:34,550 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-15 21:13:34,552 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:namespace,,1689455454829.1b0dd1d2541fcb6773c416eff63248c3. 2023-07-15 21:13:34,552 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 1b0dd1d2541fcb6773c416eff63248c3: 2023-07-15 21:13:34,552 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1689455454829.1b0dd1d2541fcb6773c416eff63248c3. 2023-07-15 21:13:34,556 DEBUG [RS:2;jenkins-hbase4:39075] regionserver.HRegionServer(1504): Waiting on 1588230740 2023-07-15 21:13:34,571 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.98 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/data/hbase/meta/1588230740/.tmp/table/4f5bae005c69456692f5979f164f4314 2023-07-15 21:13:34,578 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 4f5bae005c69456692f5979f164f4314 2023-07-15 21:13:34,579 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/data/hbase/meta/1588230740/.tmp/info/0e789dabcfab48afb6daa9c2330181c8 as hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/data/hbase/meta/1588230740/info/0e789dabcfab48afb6daa9c2330181c8 2023-07-15 21:13:34,585 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 0e789dabcfab48afb6daa9c2330181c8 2023-07-15 21:13:34,585 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/data/hbase/meta/1588230740/info/0e789dabcfab48afb6daa9c2330181c8, entries=48, sequenceid=131, filesize=10.3 K 2023-07-15 21:13:34,587 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/data/hbase/meta/1588230740/.tmp/rep_barrier/ab356a1faa7849ac93eee0c21fcbc92a as hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/data/hbase/meta/1588230740/rep_barrier/ab356a1faa7849ac93eee0c21fcbc92a 2023-07-15 21:13:34,590 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): regionserver:37853-0x1016ad2d8bb0001, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-15 21:13:34,590 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): regionserver:37853-0x1016ad2d8bb0001, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-15 21:13:34,590 INFO [RS:0;jenkins-hbase4:37853] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,37853,1689455451932; zookeeper connection closed. 2023-07-15 21:13:34,590 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@7e27d66] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@7e27d66 2023-07-15 21:13:34,595 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for ab356a1faa7849ac93eee0c21fcbc92a 2023-07-15 21:13:34,596 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/data/hbase/meta/1588230740/rep_barrier/ab356a1faa7849ac93eee0c21fcbc92a, entries=13, sequenceid=131, filesize=6.4 K 2023-07-15 21:13:34,597 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/data/hbase/meta/1588230740/.tmp/table/4f5bae005c69456692f5979f164f4314 as hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/data/hbase/meta/1588230740/table/4f5bae005c69456692f5979f164f4314 2023-07-15 21:13:34,603 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 4f5bae005c69456692f5979f164f4314 2023-07-15 21:13:34,603 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/data/hbase/meta/1588230740/table/4f5bae005c69456692f5979f164f4314, entries=24, sequenceid=131, filesize=6.9 K 2023-07-15 21:13:34,604 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~45.93 KB/47028, heapSize ~71.88 KB/73600, currentSize=0 B/0 for 1588230740 in 244ms, sequenceid=131, compaction requested=false 2023-07-15 21:13:34,619 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/data/hbase/meta/1588230740/recovered.edits/134.seqid, newMaxSeqId=134, maxSeqId=1 2023-07-15 21:13:34,619 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-15 21:13:34,620 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-07-15 21:13:34,620 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-07-15 21:13:34,620 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-07-15 21:13:34,620 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-07-15 21:13:34,741 INFO [RS:1;jenkins-hbase4:39587] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,39587,1689455451998; all regions closed. 2023-07-15 21:13:34,748 DEBUG [RS:1;jenkins-hbase4:39587] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/oldWALs 2023-07-15 21:13:34,748 INFO [RS:1;jenkins-hbase4:39587] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C39587%2C1689455451998:(num 1689455454237) 2023-07-15 21:13:34,748 DEBUG [RS:1;jenkins-hbase4:39587] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-15 21:13:34,748 INFO [RS:1;jenkins-hbase4:39587] regionserver.LeaseManager(133): Closed leases 2023-07-15 21:13:34,749 INFO [RS:1;jenkins-hbase4:39587] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-07-15 21:13:34,749 INFO [RS:1;jenkins-hbase4:39587] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-07-15 21:13:34,749 INFO [RS:1;jenkins-hbase4:39587] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-07-15 21:13:34,749 INFO [RS:1;jenkins-hbase4:39587] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-07-15 21:13:34,749 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-15 21:13:34,750 INFO [RS:1;jenkins-hbase4:39587] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:39587 2023-07-15 21:13:34,752 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): regionserver:39587-0x1016ad2d8bb0002, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,39587,1689455451998 2023-07-15 21:13:34,752 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): master:36465-0x1016ad2d8bb0000, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-15 21:13:34,752 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): regionserver:39075-0x1016ad2d8bb0003, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,39587,1689455451998 2023-07-15 21:13:34,756 INFO [RS:2;jenkins-hbase4:39075] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,39075,1689455452043; all regions closed. 2023-07-15 21:13:34,758 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,39587,1689455451998] 2023-07-15 21:13:34,758 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,39587,1689455451998; numProcessing=2 2023-07-15 21:13:34,759 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,39587,1689455451998 already deleted, retry=false 2023-07-15 21:13:34,759 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,39587,1689455451998 expired; onlineServers=1 2023-07-15 21:13:34,760 DEBUG [RS:2;jenkins-hbase4:39075] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/oldWALs 2023-07-15 21:13:34,760 INFO [RS:2;jenkins-hbase4:39075] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C39075%2C1689455452043.meta:.meta(num 1689455454448) 2023-07-15 21:13:34,773 DEBUG [RS:2;jenkins-hbase4:39075] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/oldWALs 2023-07-15 21:13:34,773 INFO [RS:2;jenkins-hbase4:39075] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C39075%2C1689455452043:(num 1689455454238) 2023-07-15 21:13:34,773 DEBUG [RS:2;jenkins-hbase4:39075] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-15 21:13:34,773 INFO [RS:2;jenkins-hbase4:39075] regionserver.LeaseManager(133): Closed leases 2023-07-15 21:13:34,774 INFO [RS:2;jenkins-hbase4:39075] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-07-15 21:13:34,774 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-15 21:13:34,776 INFO [RS:2;jenkins-hbase4:39075] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:39075 2023-07-15 21:13:34,777 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): regionserver:39075-0x1016ad2d8bb0003, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,39075,1689455452043 2023-07-15 21:13:34,777 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): master:36465-0x1016ad2d8bb0000, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-15 21:13:34,779 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,39075,1689455452043] 2023-07-15 21:13:34,779 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,39075,1689455452043; numProcessing=3 2023-07-15 21:13:34,781 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,39075,1689455452043 already deleted, retry=false 2023-07-15 21:13:34,781 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,39075,1689455452043 expired; onlineServers=0 2023-07-15 21:13:34,781 INFO [RegionServerTracker-0] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,36465,1689455450507' ***** 2023-07-15 21:13:34,781 INFO [RegionServerTracker-0] regionserver.HRegionServer(2311): STOPPED: Cluster shutdown set; onlineServer=0 2023-07-15 21:13:34,782 DEBUG [M:0;jenkins-hbase4:36465] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@46d33670, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-07-15 21:13:34,782 INFO [M:0;jenkins-hbase4:36465] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,36465,1689455450507 2023-07-15 21:13:34,782 INFO [M:0;jenkins-hbase4:36465] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,36465,1689455450507; all regions closed. 2023-07-15 21:13:34,782 DEBUG [M:0;jenkins-hbase4:36465] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-15 21:13:34,782 DEBUG [M:0;jenkins-hbase4:36465] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-07-15 21:13:34,782 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-07-15 21:13:34,782 DEBUG [M:0;jenkins-hbase4:36465] cleaner.HFileCleaner(317): Stopping file delete threads 2023-07-15 21:13:34,782 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1689455453744] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1689455453744,5,FailOnTimeoutGroup] 2023-07-15 21:13:34,782 INFO [M:0;jenkins-hbase4:36465] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-07-15 21:13:34,782 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1689455453745] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1689455453745,5,FailOnTimeoutGroup] 2023-07-15 21:13:34,782 INFO [M:0;jenkins-hbase4:36465] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-07-15 21:13:34,782 INFO [M:0;jenkins-hbase4:36465] hbase.ChoreService(369): Chore service for: master/jenkins-hbase4:0 had [] on shutdown 2023-07-15 21:13:34,783 DEBUG [M:0;jenkins-hbase4:36465] master.HMaster(1512): Stopping service threads 2023-07-15 21:13:34,783 INFO [M:0;jenkins-hbase4:36465] procedure2.RemoteProcedureDispatcher(119): Stopping procedure remote dispatcher 2023-07-15 21:13:34,783 ERROR [M:0;jenkins-hbase4:36465] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] Thread[HFileArchiver-22,5,PEWorkerGroup] Thread[HFileArchiver-23,5,PEWorkerGroup] 2023-07-15 21:13:34,784 INFO [M:0;jenkins-hbase4:36465] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-07-15 21:13:34,786 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-07-15 21:13:34,858 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): regionserver:39587-0x1016ad2d8bb0002, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-15 21:13:34,858 INFO [RS:1;jenkins-hbase4:39587] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,39587,1689455451998; zookeeper connection closed. 2023-07-15 21:13:34,858 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): regionserver:39587-0x1016ad2d8bb0002, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-15 21:13:34,858 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@7ce55dfd] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@7ce55dfd 2023-07-15 21:13:34,879 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): regionserver:39075-0x1016ad2d8bb0003, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-15 21:13:34,879 INFO [RS:2;jenkins-hbase4:39075] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,39075,1689455452043; zookeeper connection closed. 2023-07-15 21:13:34,879 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): regionserver:39075-0x1016ad2d8bb0003, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-15 21:13:34,880 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@355886ae] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@355886ae 2023-07-15 21:13:34,880 INFO [Listener at jenkins-hbase4.apache.org/41711] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 3 regionserver(s) complete 2023-07-15 21:13:34,882 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): master:36465-0x1016ad2d8bb0000, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-07-15 21:13:34,882 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): master:36465-0x1016ad2d8bb0000, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-15 21:13:34,883 DEBUG [M:0;jenkins-hbase4:36465] zookeeper.RecoverableZooKeeper(172): Node /hbase/master already deleted, retry=false 2023-07-15 21:13:34,883 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:36465-0x1016ad2d8bb0000, quorum=127.0.0.1:50024, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-15 21:13:34,883 DEBUG [M:0;jenkins-hbase4:36465] master.ActiveMasterManager(335): master:36465-0x1016ad2d8bb0000, quorum=127.0.0.1:50024, baseZNode=/hbase Failed delete of our master address node; KeeperErrorCode = NoNode for /hbase/master 2023-07-15 21:13:34,883 INFO [M:0;jenkins-hbase4:36465] assignment.AssignmentManager(315): Stopping assignment manager 2023-07-15 21:13:34,883 INFO [M:0;jenkins-hbase4:36465] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-07-15 21:13:34,884 DEBUG [M:0;jenkins-hbase4:36465] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-07-15 21:13:34,884 INFO [M:0;jenkins-hbase4:36465] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-15 21:13:34,884 DEBUG [M:0;jenkins-hbase4:36465] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-15 21:13:34,884 DEBUG [M:0;jenkins-hbase4:36465] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-07-15 21:13:34,884 DEBUG [M:0;jenkins-hbase4:36465] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-15 21:13:34,884 INFO [M:0;jenkins-hbase4:36465] regionserver.HRegion(2745): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=375.89 KB heapSize=452.16 KB 2023-07-15 21:13:34,933 INFO [M:0;jenkins-hbase4:36465] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=375.89 KB at sequenceid=899 (bloomFilter=true), to=hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/8549c6aeb1814da883e26ddd2527b767 2023-07-15 21:13:34,938 INFO [M:0;jenkins-hbase4:36465] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 8549c6aeb1814da883e26ddd2527b767 2023-07-15 21:13:34,939 DEBUG [M:0;jenkins-hbase4:36465] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/8549c6aeb1814da883e26ddd2527b767 as hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/8549c6aeb1814da883e26ddd2527b767 2023-07-15 21:13:34,945 INFO [M:0;jenkins-hbase4:36465] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 8549c6aeb1814da883e26ddd2527b767 2023-07-15 21:13:34,945 INFO [M:0;jenkins-hbase4:36465] regionserver.HStore(1080): Added hdfs://localhost:46859/user/jenkins/test-data/c04b929d-0da3-94e1-d75f-ed0d04cda313/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/8549c6aeb1814da883e26ddd2527b767, entries=119, sequenceid=899, filesize=28.7 K 2023-07-15 21:13:34,946 INFO [M:0;jenkins-hbase4:36465] regionserver.HRegion(2948): Finished flush of dataSize ~375.89 KB/384915, heapSize ~452.15 KB/463000, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 62ms, sequenceid=899, compaction requested=false 2023-07-15 21:13:34,949 INFO [M:0;jenkins-hbase4:36465] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-15 21:13:34,949 DEBUG [M:0;jenkins-hbase4:36465] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-15 21:13:34,958 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-15 21:13:34,958 INFO [M:0;jenkins-hbase4:36465] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-07-15 21:13:34,959 INFO [M:0;jenkins-hbase4:36465] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:36465 2023-07-15 21:13:34,962 DEBUG [M:0;jenkins-hbase4:36465] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase4.apache.org,36465,1689455450507 already deleted, retry=false 2023-07-15 21:13:35,064 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): master:36465-0x1016ad2d8bb0000, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-15 21:13:35,064 INFO [M:0;jenkins-hbase4:36465] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,36465,1689455450507; zookeeper connection closed. 2023-07-15 21:13:35,064 DEBUG [Listener at localhost/43845-EventThread] zookeeper.ZKWatcher(600): master:36465-0x1016ad2d8bb0000, quorum=127.0.0.1:50024, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-15 21:13:35,067 WARN [Listener at jenkins-hbase4.apache.org/41711] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-07-15 21:13:35,105 INFO [Listener at jenkins-hbase4.apache.org/41711] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-15 21:13:35,210 WARN [BP-737456516-172.31.14.131-1689455446394 heartbeating to localhost/127.0.0.1:46859] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-07-15 21:13:35,210 WARN [BP-737456516-172.31.14.131-1689455446394 heartbeating to localhost/127.0.0.1:46859] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-737456516-172.31.14.131-1689455446394 (Datanode Uuid 2125fe86-fd52-4188-8e68-af930ffa0d07) service to localhost/127.0.0.1:46859 2023-07-15 21:13:35,211 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/de3e87f0-08fc-c0d0-c969-4c410fd4e6fd/cluster_474a310c-7bd1-3ce2-91d1-9793d9692166/dfs/data/data5/current/BP-737456516-172.31.14.131-1689455446394] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-15 21:13:35,212 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/de3e87f0-08fc-c0d0-c969-4c410fd4e6fd/cluster_474a310c-7bd1-3ce2-91d1-9793d9692166/dfs/data/data6/current/BP-737456516-172.31.14.131-1689455446394] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-15 21:13:35,213 WARN [Listener at jenkins-hbase4.apache.org/41711] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-07-15 21:13:35,216 INFO [Listener at jenkins-hbase4.apache.org/41711] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-15 21:13:35,321 WARN [BP-737456516-172.31.14.131-1689455446394 heartbeating to localhost/127.0.0.1:46859] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-07-15 21:13:35,321 WARN [BP-737456516-172.31.14.131-1689455446394 heartbeating to localhost/127.0.0.1:46859] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-737456516-172.31.14.131-1689455446394 (Datanode Uuid 73d69783-f50d-42d1-a709-10d2077ced75) service to localhost/127.0.0.1:46859 2023-07-15 21:13:35,325 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/de3e87f0-08fc-c0d0-c969-4c410fd4e6fd/cluster_474a310c-7bd1-3ce2-91d1-9793d9692166/dfs/data/data3/current/BP-737456516-172.31.14.131-1689455446394] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-15 21:13:35,325 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/de3e87f0-08fc-c0d0-c969-4c410fd4e6fd/cluster_474a310c-7bd1-3ce2-91d1-9793d9692166/dfs/data/data4/current/BP-737456516-172.31.14.131-1689455446394] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-15 21:13:35,331 WARN [Listener at jenkins-hbase4.apache.org/41711] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-07-15 21:13:35,344 INFO [Listener at jenkins-hbase4.apache.org/41711] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-15 21:13:35,348 WARN [BP-737456516-172.31.14.131-1689455446394 heartbeating to localhost/127.0.0.1:46859] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-07-15 21:13:35,348 WARN [BP-737456516-172.31.14.131-1689455446394 heartbeating to localhost/127.0.0.1:46859] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-737456516-172.31.14.131-1689455446394 (Datanode Uuid 7bdc9da6-4d84-4f74-bf3b-c2a5911c3198) service to localhost/127.0.0.1:46859 2023-07-15 21:13:35,349 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/de3e87f0-08fc-c0d0-c969-4c410fd4e6fd/cluster_474a310c-7bd1-3ce2-91d1-9793d9692166/dfs/data/data1/current/BP-737456516-172.31.14.131-1689455446394] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-15 21:13:35,349 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/de3e87f0-08fc-c0d0-c969-4c410fd4e6fd/cluster_474a310c-7bd1-3ce2-91d1-9793d9692166/dfs/data/data2/current/BP-737456516-172.31.14.131-1689455446394] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-15 21:13:35,379 INFO [Listener at jenkins-hbase4.apache.org/41711] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-15 21:13:35,507 INFO [Listener at jenkins-hbase4.apache.org/41711] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-07-15 21:13:35,615 INFO [Listener at jenkins-hbase4.apache.org/41711] hbase.HBaseTestingUtility(1293): Minicluster is down