2023-07-20 07:10:13,271 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestExportSnapshot timeout: 13 mins 2023-07-20 07:10:13,545 DEBUG [main] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c07d5e8c-eba2-0ae8-aa3a-b7afa648e7e7 2023-07-20 07:10:13,546 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestMobExportSnapshot timeout: 13 mins 2023-07-20 07:10:13,546 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestMobSecureExportSnapshot timeout: 13 mins 2023-07-20 07:10:13,593 WARN [Time-limited test] util.NativeCodeLoader(62): Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 2023-07-20 07:10:13,842 INFO [Time-limited test] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=3, rsPorts=, rsClass=null, numDataNodes=3, dataNodeHosts=null, numZkServers=1, createRootDir=false, createWALDir=false} 2023-07-20 07:10:13,843 INFO [Time-limited test] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c07d5e8c-eba2-0ae8-aa3a-b7afa648e7e7/cluster_fb56fef8-ff82-388f-e012-71bf1b21f2d0, deleteOnExit=true 2023-07-20 07:10:13,843 INFO [Time-limited test] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-07-20 07:10:13,844 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c07d5e8c-eba2-0ae8-aa3a-b7afa648e7e7/test.cache.data in system properties and HBase conf 2023-07-20 07:10:13,844 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c07d5e8c-eba2-0ae8-aa3a-b7afa648e7e7/hadoop.tmp.dir in system properties and HBase conf 2023-07-20 07:10:13,845 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c07d5e8c-eba2-0ae8-aa3a-b7afa648e7e7/hadoop.log.dir in system properties and HBase conf 2023-07-20 07:10:13,845 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c07d5e8c-eba2-0ae8-aa3a-b7afa648e7e7/mapreduce.cluster.local.dir in system properties and HBase conf 2023-07-20 07:10:13,846 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c07d5e8c-eba2-0ae8-aa3a-b7afa648e7e7/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-07-20 07:10:13,846 INFO [Time-limited test] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-07-20 07:10:14,226 DEBUG [Time-limited test] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-07-20 07:10:14,232 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c07d5e8c-eba2-0ae8-aa3a-b7afa648e7e7/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-07-20 07:10:14,232 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c07d5e8c-eba2-0ae8-aa3a-b7afa648e7e7/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-07-20 07:10:14,233 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c07d5e8c-eba2-0ae8-aa3a-b7afa648e7e7/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-07-20 07:10:14,233 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c07d5e8c-eba2-0ae8-aa3a-b7afa648e7e7/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-20 07:10:14,234 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c07d5e8c-eba2-0ae8-aa3a-b7afa648e7e7/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-07-20 07:10:14,234 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c07d5e8c-eba2-0ae8-aa3a-b7afa648e7e7/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-07-20 07:10:14,235 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c07d5e8c-eba2-0ae8-aa3a-b7afa648e7e7/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-20 07:10:14,235 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c07d5e8c-eba2-0ae8-aa3a-b7afa648e7e7/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-20 07:10:14,235 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c07d5e8c-eba2-0ae8-aa3a-b7afa648e7e7/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-07-20 07:10:14,236 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c07d5e8c-eba2-0ae8-aa3a-b7afa648e7e7/nfs.dump.dir in system properties and HBase conf 2023-07-20 07:10:14,236 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c07d5e8c-eba2-0ae8-aa3a-b7afa648e7e7/java.io.tmpdir in system properties and HBase conf 2023-07-20 07:10:14,236 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c07d5e8c-eba2-0ae8-aa3a-b7afa648e7e7/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-20 07:10:14,236 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c07d5e8c-eba2-0ae8-aa3a-b7afa648e7e7/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-07-20 07:10:14,237 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c07d5e8c-eba2-0ae8-aa3a-b7afa648e7e7/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-07-20 07:10:14,844 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-07-20 07:10:14,848 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-07-20 07:10:15,120 WARN [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties 2023-07-20 07:10:15,293 INFO [Time-limited test] log.Slf4jLog(67): Logging to org.slf4j.impl.Reload4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog 2023-07-20 07:10:15,311 WARN [Time-limited test] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-20 07:10:15,345 INFO [Time-limited test] log.Slf4jLog(67): jetty-6.1.26 2023-07-20 07:10:15,390 INFO [Time-limited test] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c07d5e8c-eba2-0ae8-aa3a-b7afa648e7e7/java.io.tmpdir/Jetty_localhost_33467_hdfs____.7ok6v5/webapp 2023-07-20 07:10:15,536 INFO [Time-limited test] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:33467 2023-07-20 07:10:15,592 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-07-20 07:10:15,592 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-07-20 07:10:16,098 WARN [Listener at localhost/39649] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-20 07:10:16,184 WARN [Listener at localhost/39649] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-07-20 07:10:16,205 WARN [Listener at localhost/39649] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-20 07:10:16,212 INFO [Listener at localhost/39649] log.Slf4jLog(67): jetty-6.1.26 2023-07-20 07:10:16,221 INFO [Listener at localhost/39649] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c07d5e8c-eba2-0ae8-aa3a-b7afa648e7e7/java.io.tmpdir/Jetty_localhost_44207_datanode____.4qhi00/webapp 2023-07-20 07:10:16,363 INFO [Listener at localhost/39649] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:44207 2023-07-20 07:10:16,884 WARN [Listener at localhost/46239] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-20 07:10:16,935 WARN [Listener at localhost/46239] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-07-20 07:10:16,941 WARN [Listener at localhost/46239] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-20 07:10:16,943 INFO [Listener at localhost/46239] log.Slf4jLog(67): jetty-6.1.26 2023-07-20 07:10:16,951 INFO [Listener at localhost/46239] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c07d5e8c-eba2-0ae8-aa3a-b7afa648e7e7/java.io.tmpdir/Jetty_localhost_33157_datanode____.edohuu/webapp 2023-07-20 07:10:17,096 INFO [Listener at localhost/46239] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:33157 2023-07-20 07:10:17,114 WARN [Listener at localhost/43293] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-20 07:10:17,223 WARN [Listener at localhost/43293] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-07-20 07:10:17,233 WARN [Listener at localhost/43293] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-20 07:10:17,236 INFO [Listener at localhost/43293] log.Slf4jLog(67): jetty-6.1.26 2023-07-20 07:10:17,252 INFO [Listener at localhost/43293] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c07d5e8c-eba2-0ae8-aa3a-b7afa648e7e7/java.io.tmpdir/Jetty_localhost_41563_datanode____.6eagzo/webapp 2023-07-20 07:10:17,434 INFO [Listener at localhost/43293] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:41563 2023-07-20 07:10:17,480 WARN [Listener at localhost/46569] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-20 07:10:17,741 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x7a983e8e10233d5: Processing first storage report for DS-1b40a852-332c-48ff-8e93-fe0261d54f59 from datanode 1aec689a-a5a9-446f-8ab1-c2a66c0682fb 2023-07-20 07:10:17,742 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x7a983e8e10233d5: from storage DS-1b40a852-332c-48ff-8e93-fe0261d54f59 node DatanodeRegistration(127.0.0.1:39943, datanodeUuid=1aec689a-a5a9-446f-8ab1-c2a66c0682fb, infoPort=34987, infoSecurePort=0, ipcPort=43293, storageInfo=lv=-57;cid=testClusterID;nsid=2017861758;c=1689837014917), blocks: 0, hasStaleStorage: true, processing time: 1 msecs, invalidatedBlocks: 0 2023-07-20 07:10:17,742 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xfe561f1c7d2bc05f: Processing first storage report for DS-3ed8d10d-bdaa-4003-ab9c-320ed0daf0d7 from datanode ba9ccf6a-a63d-4d9f-b6fc-a38b3df7e48a 2023-07-20 07:10:17,743 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xfe561f1c7d2bc05f: from storage DS-3ed8d10d-bdaa-4003-ab9c-320ed0daf0d7 node DatanodeRegistration(127.0.0.1:41453, datanodeUuid=ba9ccf6a-a63d-4d9f-b6fc-a38b3df7e48a, infoPort=44939, infoSecurePort=0, ipcPort=46239, storageInfo=lv=-57;cid=testClusterID;nsid=2017861758;c=1689837014917), blocks: 0, hasStaleStorage: true, processing time: 1 msecs, invalidatedBlocks: 0 2023-07-20 07:10:17,743 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x7a983e8e10233d5: Processing first storage report for DS-96a13d6e-0b35-4047-84ec-7ec900ce794c from datanode 1aec689a-a5a9-446f-8ab1-c2a66c0682fb 2023-07-20 07:10:17,743 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x7a983e8e10233d5: from storage DS-96a13d6e-0b35-4047-84ec-7ec900ce794c node DatanodeRegistration(127.0.0.1:39943, datanodeUuid=1aec689a-a5a9-446f-8ab1-c2a66c0682fb, infoPort=34987, infoSecurePort=0, ipcPort=43293, storageInfo=lv=-57;cid=testClusterID;nsid=2017861758;c=1689837014917), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-20 07:10:17,743 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xfe561f1c7d2bc05f: Processing first storage report for DS-97a81b65-d0d2-4c03-83d2-2640d1f677cc from datanode ba9ccf6a-a63d-4d9f-b6fc-a38b3df7e48a 2023-07-20 07:10:17,743 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xfe561f1c7d2bc05f: from storage DS-97a81b65-d0d2-4c03-83d2-2640d1f677cc node DatanodeRegistration(127.0.0.1:41453, datanodeUuid=ba9ccf6a-a63d-4d9f-b6fc-a38b3df7e48a, infoPort=44939, infoSecurePort=0, ipcPort=46239, storageInfo=lv=-57;cid=testClusterID;nsid=2017861758;c=1689837014917), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-20 07:10:17,797 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x13eae0aef0d61cdb: Processing first storage report for DS-62d8a482-7641-420e-8b43-bb2bd2831202 from datanode 21c8528f-545a-4035-ac09-1bc5b0c4d66f 2023-07-20 07:10:17,797 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x13eae0aef0d61cdb: from storage DS-62d8a482-7641-420e-8b43-bb2bd2831202 node DatanodeRegistration(127.0.0.1:44629, datanodeUuid=21c8528f-545a-4035-ac09-1bc5b0c4d66f, infoPort=35915, infoSecurePort=0, ipcPort=46569, storageInfo=lv=-57;cid=testClusterID;nsid=2017861758;c=1689837014917), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-20 07:10:17,797 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x13eae0aef0d61cdb: Processing first storage report for DS-ac711ad1-62f6-4553-9427-2ff27db22af9 from datanode 21c8528f-545a-4035-ac09-1bc5b0c4d66f 2023-07-20 07:10:17,797 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x13eae0aef0d61cdb: from storage DS-ac711ad1-62f6-4553-9427-2ff27db22af9 node DatanodeRegistration(127.0.0.1:44629, datanodeUuid=21c8528f-545a-4035-ac09-1bc5b0c4d66f, infoPort=35915, infoSecurePort=0, ipcPort=46569, storageInfo=lv=-57;cid=testClusterID;nsid=2017861758;c=1689837014917), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-20 07:10:18,061 DEBUG [Listener at localhost/46569] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c07d5e8c-eba2-0ae8-aa3a-b7afa648e7e7 2023-07-20 07:10:18,146 INFO [Listener at localhost/46569] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c07d5e8c-eba2-0ae8-aa3a-b7afa648e7e7/cluster_fb56fef8-ff82-388f-e012-71bf1b21f2d0/zookeeper_0, clientPort=58010, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c07d5e8c-eba2-0ae8-aa3a-b7afa648e7e7/cluster_fb56fef8-ff82-388f-e012-71bf1b21f2d0/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c07d5e8c-eba2-0ae8-aa3a-b7afa648e7e7/cluster_fb56fef8-ff82-388f-e012-71bf1b21f2d0/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-07-20 07:10:18,166 INFO [Listener at localhost/46569] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=58010 2023-07-20 07:10:18,179 INFO [Listener at localhost/46569] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-20 07:10:18,181 INFO [Listener at localhost/46569] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-20 07:10:18,898 INFO [Listener at localhost/46569] util.FSUtils(471): Created version file at hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b with version=8 2023-07-20 07:10:18,899 INFO [Listener at localhost/46569] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/hbase-staging 2023-07-20 07:10:19,301 INFO [Listener at localhost/46569] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl 2023-07-20 07:10:19,900 INFO [Listener at localhost/46569] client.ConnectionUtils(127): master/jenkins-hbase4:0 server-side Connection retries=45 2023-07-20 07:10:19,939 INFO [Listener at localhost/46569] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-20 07:10:19,940 INFO [Listener at localhost/46569] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-20 07:10:19,940 INFO [Listener at localhost/46569] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-20 07:10:19,940 INFO [Listener at localhost/46569] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-20 07:10:19,941 INFO [Listener at localhost/46569] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-20 07:10:20,108 INFO [Listener at localhost/46569] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-07-20 07:10:20,197 DEBUG [Listener at localhost/46569] util.ClassSize(228): Using Unsafe to estimate memory layout 2023-07-20 07:10:20,314 INFO [Listener at localhost/46569] ipc.NettyRpcServer(120): Bind to /172.31.14.131:37415 2023-07-20 07:10:20,328 INFO [Listener at localhost/46569] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-20 07:10:20,330 INFO [Listener at localhost/46569] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-20 07:10:20,356 INFO [Listener at localhost/46569] zookeeper.RecoverableZooKeeper(93): Process identifier=master:37415 connecting to ZooKeeper ensemble=127.0.0.1:58010 2023-07-20 07:10:20,424 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): master:374150x0, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-20 07:10:20,432 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): master:37415-0x10181911f0f0000 connected 2023-07-20 07:10:20,490 DEBUG [Listener at localhost/46569] zookeeper.ZKUtil(164): master:37415-0x10181911f0f0000, quorum=127.0.0.1:58010, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-20 07:10:20,491 DEBUG [Listener at localhost/46569] zookeeper.ZKUtil(164): master:37415-0x10181911f0f0000, quorum=127.0.0.1:58010, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-20 07:10:20,509 DEBUG [Listener at localhost/46569] zookeeper.ZKUtil(164): master:37415-0x10181911f0f0000, quorum=127.0.0.1:58010, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-20 07:10:20,518 DEBUG [Listener at localhost/46569] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=37415 2023-07-20 07:10:20,518 DEBUG [Listener at localhost/46569] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=37415 2023-07-20 07:10:20,523 DEBUG [Listener at localhost/46569] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=37415 2023-07-20 07:10:20,524 DEBUG [Listener at localhost/46569] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=37415 2023-07-20 07:10:20,526 DEBUG [Listener at localhost/46569] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=37415 2023-07-20 07:10:20,533 INFO [Listener at localhost/46569] master.HMaster(444): hbase.rootdir=hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b, hbase.cluster.distributed=false 2023-07-20 07:10:20,622 INFO [Listener at localhost/46569] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-07-20 07:10:20,622 INFO [Listener at localhost/46569] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-20 07:10:20,622 INFO [Listener at localhost/46569] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-20 07:10:20,623 INFO [Listener at localhost/46569] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-20 07:10:20,623 INFO [Listener at localhost/46569] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-20 07:10:20,623 INFO [Listener at localhost/46569] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-20 07:10:20,630 INFO [Listener at localhost/46569] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-07-20 07:10:20,636 INFO [Listener at localhost/46569] ipc.NettyRpcServer(120): Bind to /172.31.14.131:44777 2023-07-20 07:10:20,639 INFO [Listener at localhost/46569] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-07-20 07:10:20,653 INFO [Listener at localhost/46569] mob.MobFileCache(124): MobFileCache disabled 2023-07-20 07:10:20,655 INFO [Listener at localhost/46569] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-20 07:10:20,658 INFO [Listener at localhost/46569] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-20 07:10:20,672 INFO [Listener at localhost/46569] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:44777 connecting to ZooKeeper ensemble=127.0.0.1:58010 2023-07-20 07:10:20,683 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): regionserver:447770x0, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-20 07:10:20,684 DEBUG [Listener at localhost/46569] zookeeper.ZKUtil(164): regionserver:447770x0, quorum=127.0.0.1:58010, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-20 07:10:20,687 DEBUG [Listener at localhost/46569] zookeeper.ZKUtil(164): regionserver:44777-0x10181911f0f0001, quorum=127.0.0.1:58010, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-20 07:10:20,687 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:44777-0x10181911f0f0001 connected 2023-07-20 07:10:20,691 DEBUG [Listener at localhost/46569] zookeeper.ZKUtil(164): regionserver:44777-0x10181911f0f0001, quorum=127.0.0.1:58010, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-20 07:10:20,692 DEBUG [Listener at localhost/46569] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=44777 2023-07-20 07:10:20,702 DEBUG [Listener at localhost/46569] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=44777 2023-07-20 07:10:20,703 DEBUG [Listener at localhost/46569] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=44777 2023-07-20 07:10:20,715 DEBUG [Listener at localhost/46569] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=44777 2023-07-20 07:10:20,715 DEBUG [Listener at localhost/46569] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=44777 2023-07-20 07:10:20,733 INFO [Listener at localhost/46569] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-07-20 07:10:20,734 INFO [Listener at localhost/46569] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-20 07:10:20,734 INFO [Listener at localhost/46569] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-20 07:10:20,734 INFO [Listener at localhost/46569] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-20 07:10:20,735 INFO [Listener at localhost/46569] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-20 07:10:20,735 INFO [Listener at localhost/46569] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-20 07:10:20,735 INFO [Listener at localhost/46569] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-07-20 07:10:20,740 INFO [Listener at localhost/46569] ipc.NettyRpcServer(120): Bind to /172.31.14.131:45099 2023-07-20 07:10:20,740 INFO [Listener at localhost/46569] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-07-20 07:10:20,743 INFO [Listener at localhost/46569] mob.MobFileCache(124): MobFileCache disabled 2023-07-20 07:10:20,744 INFO [Listener at localhost/46569] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-20 07:10:20,752 INFO [Listener at localhost/46569] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-20 07:10:20,755 INFO [Listener at localhost/46569] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:45099 connecting to ZooKeeper ensemble=127.0.0.1:58010 2023-07-20 07:10:20,769 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): regionserver:450990x0, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-20 07:10:20,771 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:45099-0x10181911f0f0002 connected 2023-07-20 07:10:20,771 DEBUG [Listener at localhost/46569] zookeeper.ZKUtil(164): regionserver:45099-0x10181911f0f0002, quorum=127.0.0.1:58010, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-20 07:10:20,772 DEBUG [Listener at localhost/46569] zookeeper.ZKUtil(164): regionserver:45099-0x10181911f0f0002, quorum=127.0.0.1:58010, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-20 07:10:20,773 DEBUG [Listener at localhost/46569] zookeeper.ZKUtil(164): regionserver:45099-0x10181911f0f0002, quorum=127.0.0.1:58010, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-20 07:10:20,776 DEBUG [Listener at localhost/46569] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=45099 2023-07-20 07:10:20,776 DEBUG [Listener at localhost/46569] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=45099 2023-07-20 07:10:20,777 DEBUG [Listener at localhost/46569] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=45099 2023-07-20 07:10:20,777 DEBUG [Listener at localhost/46569] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=45099 2023-07-20 07:10:20,778 DEBUG [Listener at localhost/46569] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=45099 2023-07-20 07:10:20,793 INFO [Listener at localhost/46569] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-07-20 07:10:20,793 INFO [Listener at localhost/46569] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-20 07:10:20,793 INFO [Listener at localhost/46569] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-20 07:10:20,794 INFO [Listener at localhost/46569] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-20 07:10:20,794 INFO [Listener at localhost/46569] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-20 07:10:20,794 INFO [Listener at localhost/46569] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-20 07:10:20,795 INFO [Listener at localhost/46569] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-07-20 07:10:20,797 INFO [Listener at localhost/46569] ipc.NettyRpcServer(120): Bind to /172.31.14.131:44955 2023-07-20 07:10:20,797 INFO [Listener at localhost/46569] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-07-20 07:10:20,800 INFO [Listener at localhost/46569] mob.MobFileCache(124): MobFileCache disabled 2023-07-20 07:10:20,801 INFO [Listener at localhost/46569] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-20 07:10:20,803 INFO [Listener at localhost/46569] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-20 07:10:20,804 INFO [Listener at localhost/46569] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:44955 connecting to ZooKeeper ensemble=127.0.0.1:58010 2023-07-20 07:10:20,809 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): regionserver:449550x0, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-20 07:10:20,810 DEBUG [Listener at localhost/46569] zookeeper.ZKUtil(164): regionserver:449550x0, quorum=127.0.0.1:58010, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-20 07:10:20,811 DEBUG [Listener at localhost/46569] zookeeper.ZKUtil(164): regionserver:449550x0, quorum=127.0.0.1:58010, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-20 07:10:20,812 DEBUG [Listener at localhost/46569] zookeeper.ZKUtil(164): regionserver:449550x0, quorum=127.0.0.1:58010, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-20 07:10:20,813 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:44955-0x10181911f0f0003 connected 2023-07-20 07:10:20,818 DEBUG [Listener at localhost/46569] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=44955 2023-07-20 07:10:20,819 DEBUG [Listener at localhost/46569] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=44955 2023-07-20 07:10:20,820 DEBUG [Listener at localhost/46569] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=44955 2023-07-20 07:10:20,826 DEBUG [Listener at localhost/46569] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=44955 2023-07-20 07:10:20,827 DEBUG [Listener at localhost/46569] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=44955 2023-07-20 07:10:20,830 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2168): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase4.apache.org,37415,1689837019114 2023-07-20 07:10:20,841 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): master:37415-0x10181911f0f0000, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-07-20 07:10:20,844 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:37415-0x10181911f0f0000, quorum=127.0.0.1:58010, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase4.apache.org,37415,1689837019114 2023-07-20 07:10:20,865 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): regionserver:44955-0x10181911f0f0003, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-20 07:10:20,866 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): regionserver:45099-0x10181911f0f0002, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-20 07:10:20,866 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): regionserver:44777-0x10181911f0f0001, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-20 07:10:20,865 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): master:37415-0x10181911f0f0000, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-20 07:10:20,867 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): master:37415-0x10181911f0f0000, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-20 07:10:20,868 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:37415-0x10181911f0f0000, quorum=127.0.0.1:58010, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-07-20 07:10:20,870 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:37415-0x10181911f0f0000, quorum=127.0.0.1:58010, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-07-20 07:10:20,870 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(227): Deleting ZNode for /hbase/backup-masters/jenkins-hbase4.apache.org,37415,1689837019114 from backup master directory 2023-07-20 07:10:20,876 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): master:37415-0x10181911f0f0000, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase4.apache.org,37415,1689837019114 2023-07-20 07:10:20,876 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): master:37415-0x10181911f0f0000, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-07-20 07:10:20,877 WARN [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-20 07:10:20,877 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(237): Registered as active master=jenkins-hbase4.apache.org,37415,1689837019114 2023-07-20 07:10:20,882 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating data MemStoreChunkPool with chunk size 2 MB, max count 352, initial count 0 2023-07-20 07:10:20,886 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating index MemStoreChunkPool with chunk size 204.80 KB, max count 391, initial count 0 2023-07-20 07:10:21,016 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] util.FSUtils(620): Created cluster ID file at hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/hbase.id with ID: 88139ba0-ca03-4804-9d24-03c52e309ed6 2023-07-20 07:10:21,062 INFO [master/jenkins-hbase4:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-20 07:10:21,081 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): master:37415-0x10181911f0f0000, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-20 07:10:21,159 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x69240ce0 to 127.0.0.1:58010 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-20 07:10:21,202 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2d29b157, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-20 07:10:21,236 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-20 07:10:21,239 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-07-20 07:10:21,266 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(264): ClientProtocol::create wrong number of arguments, should be hadoop 3.2 or below 2023-07-20 07:10:21,267 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(270): ClientProtocol::create wrong number of arguments, should be hadoop 2.x 2023-07-20 07:10:21,269 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(279): can not find SHOULD_REPLICATE flag, should be hadoop 2.x java.lang.IllegalArgumentException: No enum constant org.apache.hadoop.fs.CreateFlag.SHOULD_REPLICATE at java.lang.Enum.valueOf(Enum.java:238) at org.apache.hadoop.fs.CreateFlag.valueOf(CreateFlag.java:63) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.loadShouldReplicateFlag(FanOutOneBlockAsyncDFSOutputHelper.java:277) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.(FanOutOneBlockAsyncDFSOutputHelper.java:304) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:139) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-07-20 07:10:21,276 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(243): No decryptEncryptedDataEncryptionKey method in DFSClient, should be hadoop version with HDFS-12396 java.lang.NoSuchMethodException: org.apache.hadoop.hdfs.DFSClient.decryptEncryptedDataEncryptionKey(org.apache.hadoop.fs.FileEncryptionInfo) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelperWithoutHDFS12396(FanOutOneBlockAsyncDFSOutputSaslHelper.java:182) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelper(FanOutOneBlockAsyncDFSOutputSaslHelper.java:241) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.(FanOutOneBlockAsyncDFSOutputSaslHelper.java:252) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:140) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-07-20 07:10:21,277 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-20 07:10:21,326 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7693): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/MasterData/data/master/store-tmp 2023-07-20 07:10:21,419 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-20 07:10:21,420 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-07-20 07:10:21,420 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-20 07:10:21,420 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-20 07:10:21,420 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-07-20 07:10:21,420 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-20 07:10:21,420 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-20 07:10:21,421 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-20 07:10:21,423 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/MasterData/WALs/jenkins-hbase4.apache.org,37415,1689837019114 2023-07-20 07:10:21,451 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C37415%2C1689837019114, suffix=, logDir=hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/MasterData/WALs/jenkins-hbase4.apache.org,37415,1689837019114, archiveDir=hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/MasterData/oldWALs, maxLogs=10 2023-07-20 07:10:21,544 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:39943,DS-1b40a852-332c-48ff-8e93-fe0261d54f59,DISK] 2023-07-20 07:10:21,547 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:44629,DS-62d8a482-7641-420e-8b43-bb2bd2831202,DISK] 2023-07-20 07:10:21,544 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41453,DS-3ed8d10d-bdaa-4003-ab9c-320ed0daf0d7,DISK] 2023-07-20 07:10:21,558 DEBUG [RS-EventLoopGroup-5-1] asyncfs.ProtobufDecoder(123): Hadoop 3.2 and below use unshaded protobuf. java.lang.ClassNotFoundException: org.apache.hadoop.thirdparty.protobuf.MessageLite at java.net.URLClassLoader.findClass(URLClassLoader.java:387) at java.lang.ClassLoader.loadClass(ClassLoader.java:418) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:352) at java.lang.ClassLoader.loadClass(ClassLoader.java:351) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.io.asyncfs.ProtobufDecoder.(ProtobufDecoder.java:118) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.processWriteBlockResponse(FanOutOneBlockAsyncDFSOutputHelper.java:340) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$100(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$4.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:424) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:557) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.addListener(DefaultPromise.java:185) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.initialize(FanOutOneBlockAsyncDFSOutputHelper.java:418) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$300(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:476) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:471) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setSuccess0(DefaultPromise.java:625) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.trySuccess(DefaultPromise.java:105) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPromise.trySuccess(DefaultChannelPromise.java:84) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:653) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:691) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-07-20 07:10:21,642 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/MasterData/WALs/jenkins-hbase4.apache.org,37415,1689837019114/jenkins-hbase4.apache.org%2C37415%2C1689837019114.1689837021463 2023-07-20 07:10:21,643 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:41453,DS-3ed8d10d-bdaa-4003-ab9c-320ed0daf0d7,DISK], DatanodeInfoWithStorage[127.0.0.1:44629,DS-62d8a482-7641-420e-8b43-bb2bd2831202,DISK], DatanodeInfoWithStorage[127.0.0.1:39943,DS-1b40a852-332c-48ff-8e93-fe0261d54f59,DISK]] 2023-07-20 07:10:21,644 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7854): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-07-20 07:10:21,644 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-20 07:10:21,647 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7894): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-07-20 07:10:21,649 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7897): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-07-20 07:10:21,723 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-07-20 07:10:21,730 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-07-20 07:10:21,762 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-07-20 07:10:21,776 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-20 07:10:21,783 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-07-20 07:10:21,785 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-07-20 07:10:21,807 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1055): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-07-20 07:10:21,811 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-20 07:10:21,813 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1072): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62614065, jitterRate=-0.06697772443294525}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-20 07:10:21,813 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(965): Region open journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-20 07:10:21,819 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-07-20 07:10:21,845 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-07-20 07:10:21,845 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-07-20 07:10:21,848 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-07-20 07:10:21,851 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 1 msec 2023-07-20 07:10:21,894 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 43 msec 2023-07-20 07:10:21,894 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(96): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-07-20 07:10:21,934 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-07-20 07:10:21,941 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-07-20 07:10:21,976 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-07-20 07:10:21,984 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-07-20 07:10:21,986 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:37415-0x10181911f0f0000, quorum=127.0.0.1:58010, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-07-20 07:10:21,995 INFO [master/jenkins-hbase4:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-07-20 07:10:22,001 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:37415-0x10181911f0f0000, quorum=127.0.0.1:58010, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-07-20 07:10:22,006 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): master:37415-0x10181911f0f0000, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-20 07:10:22,009 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:37415-0x10181911f0f0000, quorum=127.0.0.1:58010, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-07-20 07:10:22,010 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:37415-0x10181911f0f0000, quorum=127.0.0.1:58010, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-07-20 07:10:22,029 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:37415-0x10181911f0f0000, quorum=127.0.0.1:58010, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-07-20 07:10:22,036 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): regionserver:45099-0x10181911f0f0002, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-20 07:10:22,036 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): regionserver:44955-0x10181911f0f0003, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-20 07:10:22,036 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): master:37415-0x10181911f0f0000, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-20 07:10:22,036 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): master:37415-0x10181911f0f0000, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-20 07:10:22,036 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): regionserver:44777-0x10181911f0f0001, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-20 07:10:22,048 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(744): Active/primary master=jenkins-hbase4.apache.org,37415,1689837019114, sessionid=0x10181911f0f0000, setting cluster-up flag (Was=false) 2023-07-20 07:10:22,070 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): master:37415-0x10181911f0f0000, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-20 07:10:22,079 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-07-20 07:10:22,081 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,37415,1689837019114 2023-07-20 07:10:22,091 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): master:37415-0x10181911f0f0000, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-20 07:10:22,099 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-07-20 07:10:22,101 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,37415,1689837019114 2023-07-20 07:10:22,105 WARN [master/jenkins-hbase4:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/.hbase-snapshot/.tmp 2023-07-20 07:10:22,133 INFO [RS:0;jenkins-hbase4:44777] regionserver.HRegionServer(951): ClusterId : 88139ba0-ca03-4804-9d24-03c52e309ed6 2023-07-20 07:10:22,133 INFO [RS:1;jenkins-hbase4:45099] regionserver.HRegionServer(951): ClusterId : 88139ba0-ca03-4804-9d24-03c52e309ed6 2023-07-20 07:10:22,136 INFO [RS:2;jenkins-hbase4:44955] regionserver.HRegionServer(951): ClusterId : 88139ba0-ca03-4804-9d24-03c52e309ed6 2023-07-20 07:10:22,145 DEBUG [RS:0;jenkins-hbase4:44777] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-07-20 07:10:22,145 DEBUG [RS:1;jenkins-hbase4:45099] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-07-20 07:10:22,145 DEBUG [RS:2;jenkins-hbase4:44955] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-07-20 07:10:22,155 DEBUG [RS:0;jenkins-hbase4:44777] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-07-20 07:10:22,155 DEBUG [RS:0;jenkins-hbase4:44777] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-07-20 07:10:22,161 DEBUG [RS:1;jenkins-hbase4:45099] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-07-20 07:10:22,161 DEBUG [RS:1;jenkins-hbase4:45099] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-07-20 07:10:22,161 DEBUG [RS:2;jenkins-hbase4:44955] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-07-20 07:10:22,161 DEBUG [RS:2;jenkins-hbase4:44955] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-07-20 07:10:22,162 DEBUG [RS:0;jenkins-hbase4:44777] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-07-20 07:10:22,163 DEBUG [RS:0;jenkins-hbase4:44777] zookeeper.ReadOnlyZKClient(139): Connect 0x62560554 to 127.0.0.1:58010 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-20 07:10:22,166 DEBUG [RS:2;jenkins-hbase4:44955] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-07-20 07:10:22,168 DEBUG [RS:2;jenkins-hbase4:44955] zookeeper.ReadOnlyZKClient(139): Connect 0x375ddc70 to 127.0.0.1:58010 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-20 07:10:22,169 DEBUG [RS:1;jenkins-hbase4:45099] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-07-20 07:10:22,176 DEBUG [RS:1;jenkins-hbase4:45099] zookeeper.ReadOnlyZKClient(139): Connect 0x29ed6361 to 127.0.0.1:58010 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-20 07:10:22,185 DEBUG [RS:0;jenkins-hbase4:44777] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6e2ca0eb, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-20 07:10:22,186 DEBUG [RS:0;jenkins-hbase4:44777] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@44a06b07, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-07-20 07:10:22,196 DEBUG [RS:2;jenkins-hbase4:44955] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@399a24eb, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-20 07:10:22,196 DEBUG [RS:2;jenkins-hbase4:44955] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3da5b700, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-07-20 07:10:22,230 DEBUG [RS:1;jenkins-hbase4:45099] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@272a982c, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-20 07:10:22,230 DEBUG [RS:1;jenkins-hbase4:45099] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@23150811, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-07-20 07:10:22,237 DEBUG [RS:2;jenkins-hbase4:44955] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:2;jenkins-hbase4:44955 2023-07-20 07:10:22,241 DEBUG [RS:0;jenkins-hbase4:44777] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase4:44777 2023-07-20 07:10:22,248 DEBUG [RS:1;jenkins-hbase4:45099] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase4:45099 2023-07-20 07:10:22,249 INFO [RS:1;jenkins-hbase4:45099] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-07-20 07:10:22,252 INFO [RS:1;jenkins-hbase4:45099] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-07-20 07:10:22,254 INFO [RS:0;jenkins-hbase4:44777] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-07-20 07:10:22,255 INFO [RS:0;jenkins-hbase4:44777] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-07-20 07:10:22,249 INFO [RS:2;jenkins-hbase4:44955] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-07-20 07:10:22,256 INFO [RS:2;jenkins-hbase4:44955] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-07-20 07:10:22,265 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2930): Registered master coprocessor service: service=AccessControlService 2023-07-20 07:10:22,265 DEBUG [RS:1;jenkins-hbase4:45099] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-07-20 07:10:22,267 DEBUG [RS:2;jenkins-hbase4:44955] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-07-20 07:10:22,267 INFO [master/jenkins-hbase4:0:becomeActiveMaster] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-20 07:10:22,267 DEBUG [RS:0;jenkins-hbase4:44777] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-07-20 07:10:22,268 INFO [RS:2;jenkins-hbase4:44955] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-20 07:10:22,268 DEBUG [RS:2;jenkins-hbase4:44955] regionserver.HRegionServer(1022): About to register with Master. 2023-07-20 07:10:22,268 INFO [master/jenkins-hbase4:0:becomeActiveMaster] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver loaded, priority=536870912. 2023-07-20 07:10:22,268 INFO [RS:0;jenkins-hbase4:44777] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-20 07:10:22,269 DEBUG [RS:0;jenkins-hbase4:44777] regionserver.HRegionServer(1022): About to register with Master. 2023-07-20 07:10:22,272 INFO [RS:0;jenkins-hbase4:44777] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,37415,1689837019114 with isa=jenkins-hbase4.apache.org/172.31.14.131:44777, startcode=1689837020621 2023-07-20 07:10:22,272 INFO [RS:2;jenkins-hbase4:44955] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,37415,1689837019114 with isa=jenkins-hbase4.apache.org/172.31.14.131:44955, startcode=1689837020792 2023-07-20 07:10:22,267 INFO [RS:1;jenkins-hbase4:45099] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-20 07:10:22,277 DEBUG [RS:1;jenkins-hbase4:45099] regionserver.HRegionServer(1022): About to register with Master. 2023-07-20 07:10:22,278 INFO [RS:1;jenkins-hbase4:45099] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,37415,1689837019114 with isa=jenkins-hbase4.apache.org/172.31.14.131:45099, startcode=1689837020733 2023-07-20 07:10:22,306 DEBUG [RS:1;jenkins-hbase4:45099] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-07-20 07:10:22,306 DEBUG [RS:2;jenkins-hbase4:44955] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-07-20 07:10:22,306 DEBUG [RS:0;jenkins-hbase4:44777] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-07-20 07:10:22,381 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:40231, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.0 (auth:SIMPLE), service=RegionServerStatusService 2023-07-20 07:10:22,386 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:42465, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.2 (auth:SIMPLE), service=RegionServerStatusService 2023-07-20 07:10:22,386 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:35181, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.1 (auth:SIMPLE), service=RegionServerStatusService 2023-07-20 07:10:22,392 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=37415] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-07-20 07:10:22,393 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-07-20 07:10:22,402 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=37415] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-07-20 07:10:22,403 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=37415] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-07-20 07:10:22,407 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-07-20 07:10:22,408 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-07-20 07:10:22,408 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-07-20 07:10:22,408 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-07-20 07:10:22,408 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase4:0, corePoolSize=10, maxPoolSize=10 2023-07-20 07:10:22,408 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-20 07:10:22,408 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-07-20 07:10:22,408 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-20 07:10:22,420 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1689837052420 2023-07-20 07:10:22,423 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-07-20 07:10:22,429 DEBUG [RS:0;jenkins-hbase4:44777] regionserver.HRegionServer(2830): Master is not running yet 2023-07-20 07:10:22,429 DEBUG [RS:1;jenkins-hbase4:45099] regionserver.HRegionServer(2830): Master is not running yet 2023-07-20 07:10:22,430 WARN [RS:0;jenkins-hbase4:44777] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 100 ms and then retrying. 2023-07-20 07:10:22,429 DEBUG [RS:2;jenkins-hbase4:44955] regionserver.HRegionServer(2830): Master is not running yet 2023-07-20 07:10:22,430 WARN [RS:2;jenkins-hbase4:44955] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 100 ms and then retrying. 2023-07-20 07:10:22,430 WARN [RS:1;jenkins-hbase4:45099] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 100 ms and then retrying. 2023-07-20 07:10:22,436 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-07-20 07:10:22,436 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-07-20 07:10:22,440 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-07-20 07:10:22,443 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-07-20 07:10:22,447 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-07-20 07:10:22,449 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-07-20 07:10:22,449 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-07-20 07:10:22,449 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-07-20 07:10:22,451 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-07-20 07:10:22,453 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-07-20 07:10:22,456 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-07-20 07:10:22,456 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-07-20 07:10:22,463 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-07-20 07:10:22,464 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-07-20 07:10:22,465 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1689837022465,5,FailOnTimeoutGroup] 2023-07-20 07:10:22,466 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1689837022466,5,FailOnTimeoutGroup] 2023-07-20 07:10:22,466 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-07-20 07:10:22,466 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1461): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-07-20 07:10:22,468 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-07-20 07:10:22,468 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-07-20 07:10:22,525 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-07-20 07:10:22,527 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-07-20 07:10:22,527 INFO [PEWorker-1] regionserver.HRegion(7675): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b 2023-07-20 07:10:22,531 INFO [RS:0;jenkins-hbase4:44777] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,37415,1689837019114 with isa=jenkins-hbase4.apache.org/172.31.14.131:44777, startcode=1689837020621 2023-07-20 07:10:22,531 INFO [RS:2;jenkins-hbase4:44955] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,37415,1689837019114 with isa=jenkins-hbase4.apache.org/172.31.14.131:44955, startcode=1689837020792 2023-07-20 07:10:22,533 INFO [RS:1;jenkins-hbase4:45099] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,37415,1689837019114 with isa=jenkins-hbase4.apache.org/172.31.14.131:45099, startcode=1689837020733 2023-07-20 07:10:22,542 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=37415] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,44777,1689837020621 2023-07-20 07:10:22,548 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=37415] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,44955,1689837020792 2023-07-20 07:10:22,549 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=37415] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,45099,1689837020733 2023-07-20 07:10:22,552 DEBUG [RS:0;jenkins-hbase4:44777] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b 2023-07-20 07:10:22,552 DEBUG [RS:2;jenkins-hbase4:44955] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b 2023-07-20 07:10:22,552 DEBUG [RS:1;jenkins-hbase4:45099] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b 2023-07-20 07:10:22,553 DEBUG [RS:2;jenkins-hbase4:44955] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:39649 2023-07-20 07:10:22,552 DEBUG [RS:0;jenkins-hbase4:44777] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:39649 2023-07-20 07:10:22,553 DEBUG [RS:2;jenkins-hbase4:44955] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-07-20 07:10:22,553 DEBUG [RS:1;jenkins-hbase4:45099] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:39649 2023-07-20 07:10:22,553 DEBUG [RS:0;jenkins-hbase4:44777] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-07-20 07:10:22,557 DEBUG [RS:1;jenkins-hbase4:45099] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-07-20 07:10:22,567 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): master:37415-0x10181911f0f0000, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-20 07:10:22,573 DEBUG [RS:1;jenkins-hbase4:45099] zookeeper.ZKUtil(162): regionserver:45099-0x10181911f0f0002, quorum=127.0.0.1:58010, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,45099,1689837020733 2023-07-20 07:10:22,574 DEBUG [RS:0;jenkins-hbase4:44777] zookeeper.ZKUtil(162): regionserver:44777-0x10181911f0f0001, quorum=127.0.0.1:58010, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,44777,1689837020621 2023-07-20 07:10:22,574 DEBUG [RS:2;jenkins-hbase4:44955] zookeeper.ZKUtil(162): regionserver:44955-0x10181911f0f0003, quorum=127.0.0.1:58010, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,44955,1689837020792 2023-07-20 07:10:22,573 WARN [RS:1;jenkins-hbase4:45099] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-20 07:10:22,576 INFO [RS:1;jenkins-hbase4:45099] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-20 07:10:22,576 DEBUG [RS:1;jenkins-hbase4:45099] regionserver.HRegionServer(1948): logDir=hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/WALs/jenkins-hbase4.apache.org,45099,1689837020733 2023-07-20 07:10:22,574 WARN [RS:0;jenkins-hbase4:44777] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-20 07:10:22,574 WARN [RS:2;jenkins-hbase4:44955] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-20 07:10:22,576 INFO [RS:0;jenkins-hbase4:44777] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-20 07:10:22,574 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,44955,1689837020792] 2023-07-20 07:10:22,577 DEBUG [RS:0;jenkins-hbase4:44777] regionserver.HRegionServer(1948): logDir=hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/WALs/jenkins-hbase4.apache.org,44777,1689837020621 2023-07-20 07:10:22,577 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,44777,1689837020621] 2023-07-20 07:10:22,577 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,45099,1689837020733] 2023-07-20 07:10:22,577 INFO [RS:2;jenkins-hbase4:44955] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-20 07:10:22,578 DEBUG [RS:2;jenkins-hbase4:44955] regionserver.HRegionServer(1948): logDir=hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/WALs/jenkins-hbase4.apache.org,44955,1689837020792 2023-07-20 07:10:22,614 DEBUG [PEWorker-1] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-20 07:10:22,617 DEBUG [RS:2;jenkins-hbase4:44955] zookeeper.ZKUtil(162): regionserver:44955-0x10181911f0f0003, quorum=127.0.0.1:58010, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,44955,1689837020792 2023-07-20 07:10:22,617 DEBUG [RS:1;jenkins-hbase4:45099] zookeeper.ZKUtil(162): regionserver:45099-0x10181911f0f0002, quorum=127.0.0.1:58010, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,44955,1689837020792 2023-07-20 07:10:22,618 DEBUG [RS:1;jenkins-hbase4:45099] zookeeper.ZKUtil(162): regionserver:45099-0x10181911f0f0002, quorum=127.0.0.1:58010, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,44777,1689837020621 2023-07-20 07:10:22,618 DEBUG [RS:0;jenkins-hbase4:44777] zookeeper.ZKUtil(162): regionserver:44777-0x10181911f0f0001, quorum=127.0.0.1:58010, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,44955,1689837020792 2023-07-20 07:10:22,620 DEBUG [RS:0;jenkins-hbase4:44777] zookeeper.ZKUtil(162): regionserver:44777-0x10181911f0f0001, quorum=127.0.0.1:58010, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,44777,1689837020621 2023-07-20 07:10:22,620 DEBUG [RS:1;jenkins-hbase4:45099] zookeeper.ZKUtil(162): regionserver:45099-0x10181911f0f0002, quorum=127.0.0.1:58010, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,45099,1689837020733 2023-07-20 07:10:22,620 DEBUG [RS:0;jenkins-hbase4:44777] zookeeper.ZKUtil(162): regionserver:44777-0x10181911f0f0001, quorum=127.0.0.1:58010, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,45099,1689837020733 2023-07-20 07:10:22,621 DEBUG [RS:2;jenkins-hbase4:44955] zookeeper.ZKUtil(162): regionserver:44955-0x10181911f0f0003, quorum=127.0.0.1:58010, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,44777,1689837020621 2023-07-20 07:10:22,622 DEBUG [RS:2;jenkins-hbase4:44955] zookeeper.ZKUtil(162): regionserver:44955-0x10181911f0f0003, quorum=127.0.0.1:58010, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,45099,1689837020733 2023-07-20 07:10:22,624 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-07-20 07:10:22,638 DEBUG [RS:2;jenkins-hbase4:44955] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-07-20 07:10:22,639 DEBUG [RS:0;jenkins-hbase4:44777] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-07-20 07:10:22,641 DEBUG [RS:1;jenkins-hbase4:45099] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-07-20 07:10:22,648 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/data/hbase/meta/1588230740/info 2023-07-20 07:10:22,649 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-07-20 07:10:22,652 INFO [RS:0;jenkins-hbase4:44777] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-07-20 07:10:22,653 INFO [RS:2;jenkins-hbase4:44955] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-07-20 07:10:22,654 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-20 07:10:22,655 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-07-20 07:10:22,652 INFO [RS:1;jenkins-hbase4:45099] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-07-20 07:10:22,663 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/data/hbase/meta/1588230740/rep_barrier 2023-07-20 07:10:22,664 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-07-20 07:10:22,667 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-20 07:10:22,668 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-07-20 07:10:22,671 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/data/hbase/meta/1588230740/table 2023-07-20 07:10:22,671 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-07-20 07:10:22,672 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-20 07:10:22,677 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/data/hbase/meta/1588230740 2023-07-20 07:10:22,682 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/data/hbase/meta/1588230740 2023-07-20 07:10:22,687 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-20 07:10:22,688 INFO [RS:2;jenkins-hbase4:44955] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-07-20 07:10:22,689 DEBUG [PEWorker-1] regionserver.HRegion(1055): writing seq id for 1588230740 2023-07-20 07:10:22,694 INFO [RS:2;jenkins-hbase4:44955] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-20 07:10:22,694 INFO [RS:2;jenkins-hbase4:44955] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-20 07:10:22,691 INFO [RS:0;jenkins-hbase4:44777] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-07-20 07:10:22,695 INFO [RS:1;jenkins-hbase4:45099] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-07-20 07:10:22,697 INFO [RS:2;jenkins-hbase4:44955] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-07-20 07:10:22,697 INFO [RS:0;jenkins-hbase4:44777] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-20 07:10:22,698 INFO [RS:0;jenkins-hbase4:44777] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-20 07:10:22,698 INFO [RS:1;jenkins-hbase4:45099] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-20 07:10:22,698 INFO [RS:1;jenkins-hbase4:45099] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-20 07:10:22,699 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-20 07:10:22,700 INFO [PEWorker-1] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71648301, jitterRate=0.06764288246631622}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-20 07:10:22,700 DEBUG [PEWorker-1] regionserver.HRegion(965): Region open journal for 1588230740: 2023-07-20 07:10:22,700 DEBUG [PEWorker-1] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-07-20 07:10:22,700 INFO [PEWorker-1] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-07-20 07:10:22,700 DEBUG [PEWorker-1] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-07-20 07:10:22,700 DEBUG [PEWorker-1] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-07-20 07:10:22,700 DEBUG [PEWorker-1] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-07-20 07:10:22,702 INFO [RS:1;jenkins-hbase4:45099] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-07-20 07:10:22,702 INFO [RS:0;jenkins-hbase4:44777] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-07-20 07:10:22,703 INFO [PEWorker-1] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-07-20 07:10:22,704 DEBUG [PEWorker-1] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-07-20 07:10:22,710 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-07-20 07:10:22,710 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-07-20 07:10:22,712 INFO [RS:1;jenkins-hbase4:45099] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-07-20 07:10:22,712 INFO [RS:0;jenkins-hbase4:44777] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-07-20 07:10:22,712 INFO [RS:2;jenkins-hbase4:44955] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-07-20 07:10:22,712 DEBUG [RS:1;jenkins-hbase4:45099] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-20 07:10:22,712 DEBUG [RS:0;jenkins-hbase4:44777] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-20 07:10:22,713 DEBUG [RS:2;jenkins-hbase4:44955] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-20 07:10:22,713 DEBUG [RS:0;jenkins-hbase4:44777] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-20 07:10:22,713 DEBUG [RS:1;jenkins-hbase4:45099] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-20 07:10:22,713 DEBUG [RS:0;jenkins-hbase4:44777] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-20 07:10:22,713 DEBUG [RS:1;jenkins-hbase4:45099] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-20 07:10:22,713 DEBUG [RS:0;jenkins-hbase4:44777] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-20 07:10:22,713 DEBUG [RS:1;jenkins-hbase4:45099] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-20 07:10:22,713 DEBUG [RS:0;jenkins-hbase4:44777] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-20 07:10:22,713 DEBUG [RS:1;jenkins-hbase4:45099] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-20 07:10:22,713 DEBUG [RS:0;jenkins-hbase4:44777] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-07-20 07:10:22,713 DEBUG [RS:1;jenkins-hbase4:45099] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-07-20 07:10:22,713 DEBUG [RS:0;jenkins-hbase4:44777] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-20 07:10:22,714 DEBUG [RS:1;jenkins-hbase4:45099] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-20 07:10:22,714 DEBUG [RS:0;jenkins-hbase4:44777] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-20 07:10:22,714 DEBUG [RS:1;jenkins-hbase4:45099] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-20 07:10:22,713 DEBUG [RS:2;jenkins-hbase4:44955] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-20 07:10:22,714 DEBUG [RS:1;jenkins-hbase4:45099] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-20 07:10:22,714 DEBUG [RS:0;jenkins-hbase4:44777] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-20 07:10:22,714 DEBUG [RS:1;jenkins-hbase4:45099] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-20 07:10:22,714 DEBUG [RS:0;jenkins-hbase4:44777] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-20 07:10:22,714 DEBUG [RS:2;jenkins-hbase4:44955] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-20 07:10:22,715 DEBUG [RS:2;jenkins-hbase4:44955] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-20 07:10:22,715 DEBUG [RS:2;jenkins-hbase4:44955] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-20 07:10:22,715 DEBUG [RS:2;jenkins-hbase4:44955] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-07-20 07:10:22,715 DEBUG [RS:2;jenkins-hbase4:44955] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-20 07:10:22,715 DEBUG [RS:2;jenkins-hbase4:44955] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-20 07:10:22,716 DEBUG [RS:2;jenkins-hbase4:44955] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-20 07:10:22,716 DEBUG [RS:2;jenkins-hbase4:44955] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-20 07:10:22,722 INFO [RS:1;jenkins-hbase4:45099] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-07-20 07:10:22,723 INFO [RS:0;jenkins-hbase4:44777] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-07-20 07:10:22,723 INFO [RS:1;jenkins-hbase4:45099] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-07-20 07:10:22,723 INFO [RS:0;jenkins-hbase4:44777] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-07-20 07:10:22,723 INFO [RS:1;jenkins-hbase4:45099] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-07-20 07:10:22,723 INFO [RS:0;jenkins-hbase4:44777] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-07-20 07:10:22,727 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-07-20 07:10:22,728 INFO [RS:2;jenkins-hbase4:44955] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-07-20 07:10:22,728 INFO [RS:2;jenkins-hbase4:44955] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-07-20 07:10:22,728 INFO [RS:2;jenkins-hbase4:44955] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-07-20 07:10:22,743 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-07-20 07:10:22,748 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-07-20 07:10:22,749 INFO [RS:2;jenkins-hbase4:44955] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-07-20 07:10:22,750 INFO [RS:0;jenkins-hbase4:44777] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-07-20 07:10:22,749 INFO [RS:1;jenkins-hbase4:45099] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-07-20 07:10:22,754 INFO [RS:0;jenkins-hbase4:44777] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,44777,1689837020621-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-20 07:10:22,754 INFO [RS:1;jenkins-hbase4:45099] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,45099,1689837020733-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-20 07:10:22,754 INFO [RS:2;jenkins-hbase4:44955] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,44955,1689837020792-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-20 07:10:22,776 INFO [RS:0;jenkins-hbase4:44777] regionserver.Replication(203): jenkins-hbase4.apache.org,44777,1689837020621 started 2023-07-20 07:10:22,776 INFO [RS:0;jenkins-hbase4:44777] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,44777,1689837020621, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:44777, sessionid=0x10181911f0f0001 2023-07-20 07:10:22,778 INFO [RS:2;jenkins-hbase4:44955] regionserver.Replication(203): jenkins-hbase4.apache.org,44955,1689837020792 started 2023-07-20 07:10:22,779 INFO [RS:2;jenkins-hbase4:44955] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,44955,1689837020792, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:44955, sessionid=0x10181911f0f0003 2023-07-20 07:10:22,781 INFO [RS:1;jenkins-hbase4:45099] regionserver.Replication(203): jenkins-hbase4.apache.org,45099,1689837020733 started 2023-07-20 07:10:22,781 DEBUG [RS:0;jenkins-hbase4:44777] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-07-20 07:10:22,781 DEBUG [RS:2;jenkins-hbase4:44955] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-07-20 07:10:22,781 INFO [RS:1;jenkins-hbase4:45099] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,45099,1689837020733, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:45099, sessionid=0x10181911f0f0002 2023-07-20 07:10:22,782 DEBUG [RS:2;jenkins-hbase4:44955] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,44955,1689837020792 2023-07-20 07:10:22,782 DEBUG [RS:0;jenkins-hbase4:44777] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,44777,1689837020621 2023-07-20 07:10:22,783 DEBUG [RS:2;jenkins-hbase4:44955] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,44955,1689837020792' 2023-07-20 07:10:22,783 DEBUG [RS:1;jenkins-hbase4:45099] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-07-20 07:10:22,784 DEBUG [RS:2;jenkins-hbase4:44955] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-20 07:10:22,783 DEBUG [RS:0;jenkins-hbase4:44777] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,44777,1689837020621' 2023-07-20 07:10:22,784 DEBUG [RS:0;jenkins-hbase4:44777] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-20 07:10:22,784 DEBUG [RS:1;jenkins-hbase4:45099] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,45099,1689837020733 2023-07-20 07:10:22,784 DEBUG [RS:1;jenkins-hbase4:45099] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,45099,1689837020733' 2023-07-20 07:10:22,785 DEBUG [RS:1;jenkins-hbase4:45099] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-20 07:10:22,789 DEBUG [RS:1;jenkins-hbase4:45099] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-20 07:10:22,789 DEBUG [RS:2;jenkins-hbase4:44955] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-20 07:10:22,789 DEBUG [RS:0;jenkins-hbase4:44777] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-20 07:10:22,790 DEBUG [RS:2;jenkins-hbase4:44955] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-07-20 07:10:22,790 DEBUG [RS:1;jenkins-hbase4:45099] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-07-20 07:10:22,790 DEBUG [RS:2;jenkins-hbase4:44955] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-07-20 07:10:22,790 DEBUG [RS:1;jenkins-hbase4:45099] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-07-20 07:10:22,790 DEBUG [RS:2;jenkins-hbase4:44955] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,44955,1689837020792 2023-07-20 07:10:22,795 DEBUG [RS:0;jenkins-hbase4:44777] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-07-20 07:10:22,799 DEBUG [RS:0;jenkins-hbase4:44777] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-07-20 07:10:22,799 DEBUG [RS:0;jenkins-hbase4:44777] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,44777,1689837020621 2023-07-20 07:10:22,799 DEBUG [RS:0;jenkins-hbase4:44777] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,44777,1689837020621' 2023-07-20 07:10:22,799 DEBUG [RS:0;jenkins-hbase4:44777] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 07:10:22,790 DEBUG [RS:1;jenkins-hbase4:45099] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,45099,1689837020733 2023-07-20 07:10:22,799 DEBUG [RS:2;jenkins-hbase4:44955] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,44955,1689837020792' 2023-07-20 07:10:22,803 DEBUG [RS:2;jenkins-hbase4:44955] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 07:10:22,803 DEBUG [RS:0;jenkins-hbase4:44777] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 07:10:22,802 DEBUG [RS:1;jenkins-hbase4:45099] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,45099,1689837020733' 2023-07-20 07:10:22,806 DEBUG [RS:1;jenkins-hbase4:45099] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 07:10:22,809 DEBUG [RS:2;jenkins-hbase4:44955] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 07:10:22,809 DEBUG [RS:0;jenkins-hbase4:44777] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-07-20 07:10:22,809 INFO [RS:0;jenkins-hbase4:44777] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-07-20 07:10:22,809 INFO [RS:0;jenkins-hbase4:44777] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-07-20 07:10:22,809 DEBUG [RS:1;jenkins-hbase4:45099] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 07:10:22,809 DEBUG [RS:2;jenkins-hbase4:44955] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-07-20 07:10:22,809 INFO [RS:2;jenkins-hbase4:44955] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-07-20 07:10:22,810 INFO [RS:2;jenkins-hbase4:44955] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-07-20 07:10:22,811 DEBUG [RS:1;jenkins-hbase4:45099] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-07-20 07:10:22,811 INFO [RS:1;jenkins-hbase4:45099] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-07-20 07:10:22,811 INFO [RS:1;jenkins-hbase4:45099] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-07-20 07:10:22,901 DEBUG [jenkins-hbase4:37415] assignment.AssignmentManager(2176): Processing assignQueue; systemServersCount=3, allServersCount=3 2023-07-20 07:10:22,907 DEBUG [jenkins-hbase4:37415] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-20 07:10:22,913 DEBUG [jenkins-hbase4:37415] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-20 07:10:22,913 DEBUG [jenkins-hbase4:37415] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-20 07:10:22,913 DEBUG [jenkins-hbase4:37415] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-20 07:10:22,913 DEBUG [jenkins-hbase4:37415] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-20 07:10:22,928 INFO [RS:2;jenkins-hbase4:44955] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C44955%2C1689837020792, suffix=, logDir=hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/WALs/jenkins-hbase4.apache.org,44955,1689837020792, archiveDir=hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/oldWALs, maxLogs=32 2023-07-20 07:10:22,929 INFO [RS:1;jenkins-hbase4:45099] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C45099%2C1689837020733, suffix=, logDir=hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/WALs/jenkins-hbase4.apache.org,45099,1689837020733, archiveDir=hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/oldWALs, maxLogs=32 2023-07-20 07:10:22,937 INFO [PEWorker-4] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,45099,1689837020733, state=OPENING 2023-07-20 07:10:22,945 DEBUG [PEWorker-4] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-07-20 07:10:22,948 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): master:37415-0x10181911f0f0000, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-20 07:10:22,949 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-07-20 07:10:22,955 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,45099,1689837020733}] 2023-07-20 07:10:22,973 INFO [RS:0;jenkins-hbase4:44777] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C44777%2C1689837020621, suffix=, logDir=hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/WALs/jenkins-hbase4.apache.org,44777,1689837020621, archiveDir=hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/oldWALs, maxLogs=32 2023-07-20 07:10:23,004 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:44629,DS-62d8a482-7641-420e-8b43-bb2bd2831202,DISK] 2023-07-20 07:10:23,005 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:39943,DS-1b40a852-332c-48ff-8e93-fe0261d54f59,DISK] 2023-07-20 07:10:23,006 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41453,DS-3ed8d10d-bdaa-4003-ab9c-320ed0daf0d7,DISK] 2023-07-20 07:10:23,024 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41453,DS-3ed8d10d-bdaa-4003-ab9c-320ed0daf0d7,DISK] 2023-07-20 07:10:23,025 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:39943,DS-1b40a852-332c-48ff-8e93-fe0261d54f59,DISK] 2023-07-20 07:10:23,025 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:44629,DS-62d8a482-7641-420e-8b43-bb2bd2831202,DISK] 2023-07-20 07:10:23,052 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41453,DS-3ed8d10d-bdaa-4003-ab9c-320ed0daf0d7,DISK] 2023-07-20 07:10:23,055 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:39943,DS-1b40a852-332c-48ff-8e93-fe0261d54f59,DISK] 2023-07-20 07:10:23,055 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:44629,DS-62d8a482-7641-420e-8b43-bb2bd2831202,DISK] 2023-07-20 07:10:23,065 INFO [RS:1;jenkins-hbase4:45099] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/WALs/jenkins-hbase4.apache.org,45099,1689837020733/jenkins-hbase4.apache.org%2C45099%2C1689837020733.1689837022943 2023-07-20 07:10:23,072 DEBUG [RS:1;jenkins-hbase4:45099] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:44629,DS-62d8a482-7641-420e-8b43-bb2bd2831202,DISK], DatanodeInfoWithStorage[127.0.0.1:41453,DS-3ed8d10d-bdaa-4003-ab9c-320ed0daf0d7,DISK], DatanodeInfoWithStorage[127.0.0.1:39943,DS-1b40a852-332c-48ff-8e93-fe0261d54f59,DISK]] 2023-07-20 07:10:23,076 INFO [RS:0;jenkins-hbase4:44777] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/WALs/jenkins-hbase4.apache.org,44777,1689837020621/jenkins-hbase4.apache.org%2C44777%2C1689837020621.1689837022975 2023-07-20 07:10:23,076 DEBUG [RS:0;jenkins-hbase4:44777] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:39943,DS-1b40a852-332c-48ff-8e93-fe0261d54f59,DISK], DatanodeInfoWithStorage[127.0.0.1:41453,DS-3ed8d10d-bdaa-4003-ab9c-320ed0daf0d7,DISK], DatanodeInfoWithStorage[127.0.0.1:44629,DS-62d8a482-7641-420e-8b43-bb2bd2831202,DISK]] 2023-07-20 07:10:23,084 INFO [RS:2;jenkins-hbase4:44955] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/WALs/jenkins-hbase4.apache.org,44955,1689837020792/jenkins-hbase4.apache.org%2C44955%2C1689837020792.1689837022940 2023-07-20 07:10:23,087 DEBUG [RS:2;jenkins-hbase4:44955] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:44629,DS-62d8a482-7641-420e-8b43-bb2bd2831202,DISK], DatanodeInfoWithStorage[127.0.0.1:39943,DS-1b40a852-332c-48ff-8e93-fe0261d54f59,DISK], DatanodeInfoWithStorage[127.0.0.1:41453,DS-3ed8d10d-bdaa-4003-ab9c-320ed0daf0d7,DISK]] 2023-07-20 07:10:23,238 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,45099,1689837020733 2023-07-20 07:10:23,241 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-20 07:10:23,249 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:42060, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-20 07:10:23,267 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:meta,,1.1588230740 2023-07-20 07:10:23,267 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-20 07:10:23,272 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C45099%2C1689837020733.meta, suffix=.meta, logDir=hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/WALs/jenkins-hbase4.apache.org,45099,1689837020733, archiveDir=hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/oldWALs, maxLogs=32 2023-07-20 07:10:23,307 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41453,DS-3ed8d10d-bdaa-4003-ab9c-320ed0daf0d7,DISK] 2023-07-20 07:10:23,319 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:39943,DS-1b40a852-332c-48ff-8e93-fe0261d54f59,DISK] 2023-07-20 07:10:23,322 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:44629,DS-62d8a482-7641-420e-8b43-bb2bd2831202,DISK] 2023-07-20 07:10:23,347 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/WALs/jenkins-hbase4.apache.org,45099,1689837020733/jenkins-hbase4.apache.org%2C45099%2C1689837020733.meta.1689837023275.meta 2023-07-20 07:10:23,348 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:41453,DS-3ed8d10d-bdaa-4003-ab9c-320ed0daf0d7,DISK], DatanodeInfoWithStorage[127.0.0.1:44629,DS-62d8a482-7641-420e-8b43-bb2bd2831202,DISK], DatanodeInfoWithStorage[127.0.0.1:39943,DS-1b40a852-332c-48ff-8e93-fe0261d54f59,DISK]] 2023-07-20 07:10:23,348 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-07-20 07:10:23,350 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=AccessControlService 2023-07-20 07:10:23,353 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-20 07:10:23,354 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-07-20 07:10:23,357 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-07-20 07:10:23,359 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-07-20 07:10:23,377 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-07-20 07:10:23,377 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-20 07:10:23,377 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 1588230740 2023-07-20 07:10:23,377 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 1588230740 2023-07-20 07:10:23,387 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-07-20 07:10:23,391 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/data/hbase/meta/1588230740/info 2023-07-20 07:10:23,392 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/data/hbase/meta/1588230740/info 2023-07-20 07:10:23,392 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-07-20 07:10:23,393 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-20 07:10:23,394 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-07-20 07:10:23,397 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/data/hbase/meta/1588230740/rep_barrier 2023-07-20 07:10:23,397 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/data/hbase/meta/1588230740/rep_barrier 2023-07-20 07:10:23,398 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-07-20 07:10:23,400 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-20 07:10:23,400 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-07-20 07:10:23,411 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/data/hbase/meta/1588230740/table 2023-07-20 07:10:23,411 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/data/hbase/meta/1588230740/table 2023-07-20 07:10:23,412 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-07-20 07:10:23,414 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-20 07:10:23,417 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/data/hbase/meta/1588230740 2023-07-20 07:10:23,421 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/data/hbase/meta/1588230740 2023-07-20 07:10:23,434 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-20 07:10:23,438 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 1588230740 2023-07-20 07:10:23,441 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65092572, jitterRate=-0.03004509210586548}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-20 07:10:23,444 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 1588230740: 2023-07-20 07:10:23,459 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1689837023227 2023-07-20 07:10:23,488 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:meta,,1.1588230740 2023-07-20 07:10:23,490 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:meta,,1.1588230740 2023-07-20 07:10:23,491 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,45099,1689837020733, state=OPEN 2023-07-20 07:10:23,496 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): master:37415-0x10181911f0f0000, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-07-20 07:10:23,496 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-07-20 07:10:23,502 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-07-20 07:10:23,502 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,45099,1689837020733 in 541 msec 2023-07-20 07:10:23,510 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-07-20 07:10:23,510 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 778 msec 2023-07-20 07:10:23,519 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 1.2370 sec 2023-07-20 07:10:23,519 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(953): Wait for region servers to report in: status=null, state=RUNNING, startTime=1689837023519, completionTime=-1 2023-07-20 07:10:23,519 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=3; waited=0ms, expected min=3 server(s), max=3 server(s), master is running 2023-07-20 07:10:23,519 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1517): Joining cluster... 2023-07-20 07:10:23,607 DEBUG [hconnection-0x7a39bf3a-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-20 07:10:23,611 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:42066, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-20 07:10:23,639 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1529): Number of RegionServers=3 2023-07-20 07:10:23,639 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1689837083639 2023-07-20 07:10:23,640 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1689837143640 2023-07-20 07:10:23,640 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1536): Joined the cluster in 120 msec 2023-07-20 07:10:23,682 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,37415,1689837019114-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-20 07:10:23,683 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,37415,1689837019114-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-07-20 07:10:23,683 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,37415,1689837019114-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-07-20 07:10:23,685 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase4:37415, period=300000, unit=MILLISECONDS is enabled. 2023-07-20 07:10:23,686 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-07-20 07:10:23,695 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2023-07-20 07:10:23,704 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-07-20 07:10:23,706 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2148): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-07-20 07:10:23,718 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-07-20 07:10:23,722 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-07-20 07:10:23,726 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-20 07:10:23,751 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/.tmp/data/hbase/namespace/37013e44b8b1510f4bef8010666ea4e1 2023-07-20 07:10:23,755 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/.tmp/data/hbase/namespace/37013e44b8b1510f4bef8010666ea4e1 empty. 2023-07-20 07:10:23,755 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/.tmp/data/hbase/namespace/37013e44b8b1510f4bef8010666ea4e1 2023-07-20 07:10:23,756 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-07-20 07:10:23,812 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-07-20 07:10:23,815 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7675): creating {ENCODED => 37013e44b8b1510f4bef8010666ea4e1, NAME => 'hbase:namespace,,1689837023706.37013e44b8b1510f4bef8010666ea4e1.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/.tmp 2023-07-20 07:10:23,841 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1689837023706.37013e44b8b1510f4bef8010666ea4e1.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-20 07:10:23,841 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1604): Closing 37013e44b8b1510f4bef8010666ea4e1, disabling compactions & flushes 2023-07-20 07:10:23,841 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1689837023706.37013e44b8b1510f4bef8010666ea4e1. 2023-07-20 07:10:23,841 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1689837023706.37013e44b8b1510f4bef8010666ea4e1. 2023-07-20 07:10:23,841 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1689837023706.37013e44b8b1510f4bef8010666ea4e1. after waiting 0 ms 2023-07-20 07:10:23,841 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1689837023706.37013e44b8b1510f4bef8010666ea4e1. 2023-07-20 07:10:23,841 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1838): Closed hbase:namespace,,1689837023706.37013e44b8b1510f4bef8010666ea4e1. 2023-07-20 07:10:23,841 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1558): Region close journal for 37013e44b8b1510f4bef8010666ea4e1: 2023-07-20 07:10:23,846 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-07-20 07:10:23,862 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1689837023706.37013e44b8b1510f4bef8010666ea4e1.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1689837023849"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689837023849"}]},"ts":"1689837023849"} 2023-07-20 07:10:23,897 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-07-20 07:10:23,900 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-20 07:10:23,904 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689837023900"}]},"ts":"1689837023900"} 2023-07-20 07:10:23,910 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-07-20 07:10:23,915 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-20 07:10:23,917 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-20 07:10:23,917 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-20 07:10:23,917 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-20 07:10:23,917 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-20 07:10:23,920 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=37013e44b8b1510f4bef8010666ea4e1, ASSIGN}] 2023-07-20 07:10:23,924 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=37013e44b8b1510f4bef8010666ea4e1, ASSIGN 2023-07-20 07:10:23,926 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=37013e44b8b1510f4bef8010666ea4e1, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,45099,1689837020733; forceNewPlan=false, retain=false 2023-07-20 07:10:24,078 INFO [jenkins-hbase4:37415] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-07-20 07:10:24,080 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=37013e44b8b1510f4bef8010666ea4e1, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,45099,1689837020733 2023-07-20 07:10:24,080 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1689837023706.37013e44b8b1510f4bef8010666ea4e1.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1689837024080"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689837024080"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689837024080"}]},"ts":"1689837024080"} 2023-07-20 07:10:24,084 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure 37013e44b8b1510f4bef8010666ea4e1, server=jenkins-hbase4.apache.org,45099,1689837020733}] 2023-07-20 07:10:24,246 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:namespace,,1689837023706.37013e44b8b1510f4bef8010666ea4e1. 2023-07-20 07:10:24,246 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 37013e44b8b1510f4bef8010666ea4e1, NAME => 'hbase:namespace,,1689837023706.37013e44b8b1510f4bef8010666ea4e1.', STARTKEY => '', ENDKEY => ''} 2023-07-20 07:10:24,247 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:namespace,,1689837023706.37013e44b8b1510f4bef8010666ea4e1. service=AccessControlService 2023-07-20 07:10:24,247 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-20 07:10:24,248 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace 37013e44b8b1510f4bef8010666ea4e1 2023-07-20 07:10:24,248 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1689837023706.37013e44b8b1510f4bef8010666ea4e1.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-20 07:10:24,248 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 37013e44b8b1510f4bef8010666ea4e1 2023-07-20 07:10:24,248 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 37013e44b8b1510f4bef8010666ea4e1 2023-07-20 07:10:24,250 INFO [StoreOpener-37013e44b8b1510f4bef8010666ea4e1-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 37013e44b8b1510f4bef8010666ea4e1 2023-07-20 07:10:24,253 DEBUG [StoreOpener-37013e44b8b1510f4bef8010666ea4e1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/data/hbase/namespace/37013e44b8b1510f4bef8010666ea4e1/info 2023-07-20 07:10:24,253 DEBUG [StoreOpener-37013e44b8b1510f4bef8010666ea4e1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/data/hbase/namespace/37013e44b8b1510f4bef8010666ea4e1/info 2023-07-20 07:10:24,253 INFO [StoreOpener-37013e44b8b1510f4bef8010666ea4e1-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 37013e44b8b1510f4bef8010666ea4e1 columnFamilyName info 2023-07-20 07:10:24,254 INFO [StoreOpener-37013e44b8b1510f4bef8010666ea4e1-1] regionserver.HStore(310): Store=37013e44b8b1510f4bef8010666ea4e1/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-20 07:10:24,256 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/data/hbase/namespace/37013e44b8b1510f4bef8010666ea4e1 2023-07-20 07:10:24,257 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/data/hbase/namespace/37013e44b8b1510f4bef8010666ea4e1 2023-07-20 07:10:24,262 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 37013e44b8b1510f4bef8010666ea4e1 2023-07-20 07:10:24,265 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/data/hbase/namespace/37013e44b8b1510f4bef8010666ea4e1/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-20 07:10:24,266 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 37013e44b8b1510f4bef8010666ea4e1; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63739330, jitterRate=-0.05020996928215027}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-20 07:10:24,266 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 37013e44b8b1510f4bef8010666ea4e1: 2023-07-20 07:10:24,268 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:namespace,,1689837023706.37013e44b8b1510f4bef8010666ea4e1., pid=6, masterSystemTime=1689837024239 2023-07-20 07:10:24,272 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:namespace,,1689837023706.37013e44b8b1510f4bef8010666ea4e1. 2023-07-20 07:10:24,272 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:namespace,,1689837023706.37013e44b8b1510f4bef8010666ea4e1. 2023-07-20 07:10:24,273 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=37013e44b8b1510f4bef8010666ea4e1, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,45099,1689837020733 2023-07-20 07:10:24,273 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1689837023706.37013e44b8b1510f4bef8010666ea4e1.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1689837024273"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689837024273"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689837024273"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689837024273"}]},"ts":"1689837024273"} 2023-07-20 07:10:24,281 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-07-20 07:10:24,281 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure 37013e44b8b1510f4bef8010666ea4e1, server=jenkins-hbase4.apache.org,45099,1689837020733 in 194 msec 2023-07-20 07:10:24,285 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-07-20 07:10:24,286 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=37013e44b8b1510f4bef8010666ea4e1, ASSIGN in 361 msec 2023-07-20 07:10:24,287 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-20 07:10:24,287 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689837024287"}]},"ts":"1689837024287"} 2023-07-20 07:10:24,290 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-07-20 07:10:24,294 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-07-20 07:10:24,301 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 586 msec 2023-07-20 07:10:24,321 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:37415-0x10181911f0f0000, quorum=127.0.0.1:58010, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-07-20 07:10:24,323 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): master:37415-0x10181911f0f0000, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-07-20 07:10:24,323 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): master:37415-0x10181911f0f0000, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-20 07:10:24,365 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-07-20 07:10:24,386 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): master:37415-0x10181911f0f0000, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-07-20 07:10:24,395 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 38 msec 2023-07-20 07:10:24,399 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-07-20 07:10:24,412 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): master:37415-0x10181911f0f0000, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-07-20 07:10:24,419 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 19 msec 2023-07-20 07:10:24,425 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): master:37415-0x10181911f0f0000, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-07-20 07:10:24,428 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): master:37415-0x10181911f0f0000, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-07-20 07:10:24,428 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1083): Master has completed initialization 3.551sec 2023-07-20 07:10:24,432 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-07-20 07:10:24,433 INFO [master/jenkins-hbase4:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-07-20 07:10:24,433 INFO [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-07-20 07:10:24,435 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,37415,1689837019114-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-07-20 07:10:24,436 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,37415,1689837019114-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-07-20 07:10:24,451 DEBUG [Listener at localhost/46569] zookeeper.ReadOnlyZKClient(139): Connect 0x37ed2880 to 127.0.0.1:58010 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-20 07:10:24,458 DEBUG [Listener at localhost/46569] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@416d673c, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-20 07:10:24,465 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster$4(2112): Client=null/null create 'hbase:acl', {NAME => 'l', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-07-20 07:10:24,470 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:acl 2023-07-20 07:10:24,472 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_PRE_OPERATION 2023-07-20 07:10:24,474 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-20 07:10:24,479 DEBUG [hconnection-0x2a6c5873-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-20 07:10:24,479 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(700): Client=null/null procedure request for creating table: namespace: "hbase" qualifier: "acl" procId is: 9 2023-07-20 07:10:24,479 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/.tmp/data/hbase/acl/a99cc01e32f8591c1e330231bf41e07d 2023-07-20 07:10:24,480 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/.tmp/data/hbase/acl/a99cc01e32f8591c1e330231bf41e07d empty. 2023-07-20 07:10:24,483 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/.tmp/data/hbase/acl/a99cc01e32f8591c1e330231bf41e07d 2023-07-20 07:10:24,483 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived hbase:acl regions 2023-07-20 07:10:24,489 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-20 07:10:24,503 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:42070, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-20 07:10:24,509 INFO [Listener at localhost/46569] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase4.apache.org,37415,1689837019114 2023-07-20 07:10:24,509 INFO [Listener at localhost/46569] hbase.HBaseTestingUtility(2699): Starting mini mapreduce cluster... 2023-07-20 07:10:24,509 INFO [Listener at localhost/46569] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c07d5e8c-eba2-0ae8-aa3a-b7afa648e7e7/test.cache.data in system properties and HBase conf 2023-07-20 07:10:24,509 INFO [Listener at localhost/46569] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c07d5e8c-eba2-0ae8-aa3a-b7afa648e7e7/hadoop.tmp.dir in system properties and HBase conf 2023-07-20 07:10:24,509 INFO [Listener at localhost/46569] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c07d5e8c-eba2-0ae8-aa3a-b7afa648e7e7/hadoop.log.dir in system properties and HBase conf 2023-07-20 07:10:24,509 INFO [Listener at localhost/46569] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c07d5e8c-eba2-0ae8-aa3a-b7afa648e7e7/mapreduce.cluster.local.dir in system properties and HBase conf 2023-07-20 07:10:24,509 INFO [Listener at localhost/46569] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c07d5e8c-eba2-0ae8-aa3a-b7afa648e7e7/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-07-20 07:10:24,509 INFO [Listener at localhost/46569] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-07-20 07:10:24,510 INFO [Listener at localhost/46569] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c07d5e8c-eba2-0ae8-aa3a-b7afa648e7e7/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-07-20 07:10:24,510 INFO [Listener at localhost/46569] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c07d5e8c-eba2-0ae8-aa3a-b7afa648e7e7/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-07-20 07:10:24,510 INFO [Listener at localhost/46569] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c07d5e8c-eba2-0ae8-aa3a-b7afa648e7e7/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-07-20 07:10:24,510 INFO [Listener at localhost/46569] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c07d5e8c-eba2-0ae8-aa3a-b7afa648e7e7/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-20 07:10:24,510 INFO [Listener at localhost/46569] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c07d5e8c-eba2-0ae8-aa3a-b7afa648e7e7/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-07-20 07:10:24,510 INFO [Listener at localhost/46569] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c07d5e8c-eba2-0ae8-aa3a-b7afa648e7e7/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-07-20 07:10:24,510 INFO [Listener at localhost/46569] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c07d5e8c-eba2-0ae8-aa3a-b7afa648e7e7/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-20 07:10:24,510 INFO [Listener at localhost/46569] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c07d5e8c-eba2-0ae8-aa3a-b7afa648e7e7/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-20 07:10:24,510 INFO [Listener at localhost/46569] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c07d5e8c-eba2-0ae8-aa3a-b7afa648e7e7/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-07-20 07:10:24,510 INFO [Listener at localhost/46569] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c07d5e8c-eba2-0ae8-aa3a-b7afa648e7e7/nfs.dump.dir in system properties and HBase conf 2023-07-20 07:10:24,510 INFO [Listener at localhost/46569] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c07d5e8c-eba2-0ae8-aa3a-b7afa648e7e7/java.io.tmpdir in system properties and HBase conf 2023-07-20 07:10:24,510 INFO [Listener at localhost/46569] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c07d5e8c-eba2-0ae8-aa3a-b7afa648e7e7/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-20 07:10:24,511 INFO [Listener at localhost/46569] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c07d5e8c-eba2-0ae8-aa3a-b7afa648e7e7/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-07-20 07:10:24,511 INFO [Listener at localhost/46569] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c07d5e8c-eba2-0ae8-aa3a-b7afa648e7e7/fs.s3a.committer.staging.tmp.path in system properties and HBase conf 2023-07-20 07:10:24,526 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/.tmp/data/hbase/acl/.tabledesc/.tableinfo.0000000001 2023-07-20 07:10:24,529 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(7675): creating {ENCODED => a99cc01e32f8591c1e330231bf41e07d, NAME => 'hbase:acl,,1689837024458.a99cc01e32f8591c1e330231bf41e07d.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:acl', {NAME => 'l', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/.tmp 2023-07-20 07:10:24,597 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-20 07:10:24,599 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(866): Instantiated hbase:acl,,1689837024458.a99cc01e32f8591c1e330231bf41e07d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-20 07:10:24,600 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1604): Closing a99cc01e32f8591c1e330231bf41e07d, disabling compactions & flushes 2023-07-20 07:10:24,600 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1626): Closing region hbase:acl,,1689837024458.a99cc01e32f8591c1e330231bf41e07d. 2023-07-20 07:10:24,600 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:acl,,1689837024458.a99cc01e32f8591c1e330231bf41e07d. 2023-07-20 07:10:24,601 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:acl,,1689837024458.a99cc01e32f8591c1e330231bf41e07d. after waiting 0 ms 2023-07-20 07:10:24,601 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:acl,,1689837024458.a99cc01e32f8591c1e330231bf41e07d. 2023-07-20 07:10:24,601 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1838): Closed hbase:acl,,1689837024458.a99cc01e32f8591c1e330231bf41e07d. 2023-07-20 07:10:24,601 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1558): Region close journal for a99cc01e32f8591c1e330231bf41e07d: 2023-07-20 07:10:24,607 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_ADD_TO_META 2023-07-20 07:10:24,609 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:acl,,1689837024458.a99cc01e32f8591c1e330231bf41e07d.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1689837024608"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689837024608"}]},"ts":"1689837024608"} 2023-07-20 07:10:24,612 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-07-20 07:10:24,622 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-20 07:10:24,622 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:acl","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689837024622"}]},"ts":"1689837024622"} 2023-07-20 07:10:24,636 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=hbase:acl, state=ENABLING in hbase:meta 2023-07-20 07:10:24,643 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-20 07:10:24,644 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-20 07:10:24,644 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-20 07:10:24,645 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-20 07:10:24,645 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-20 07:10:24,645 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:acl, region=a99cc01e32f8591c1e330231bf41e07d, ASSIGN}] 2023-07-20 07:10:24,649 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:acl, region=a99cc01e32f8591c1e330231bf41e07d, ASSIGN 2023-07-20 07:10:24,654 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:acl, region=a99cc01e32f8591c1e330231bf41e07d, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,44955,1689837020792; forceNewPlan=false, retain=false 2023-07-20 07:10:24,798 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-20 07:10:24,804 INFO [jenkins-hbase4:37415] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-07-20 07:10:24,806 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=a99cc01e32f8591c1e330231bf41e07d, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,44955,1689837020792 2023-07-20 07:10:24,806 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:acl,,1689837024458.a99cc01e32f8591c1e330231bf41e07d.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1689837024806"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689837024806"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689837024806"}]},"ts":"1689837024806"} 2023-07-20 07:10:24,810 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE; OpenRegionProcedure a99cc01e32f8591c1e330231bf41e07d, server=jenkins-hbase4.apache.org,44955,1689837020792}] 2023-07-20 07:10:24,966 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,44955,1689837020792 2023-07-20 07:10:24,966 DEBUG [RSProcedureDispatcher-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-20 07:10:24,971 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:40622, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-20 07:10:24,996 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:acl,,1689837024458.a99cc01e32f8591c1e330231bf41e07d. 2023-07-20 07:10:24,997 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => a99cc01e32f8591c1e330231bf41e07d, NAME => 'hbase:acl,,1689837024458.a99cc01e32f8591c1e330231bf41e07d.', STARTKEY => '', ENDKEY => ''} 2023-07-20 07:10:24,997 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:acl,,1689837024458.a99cc01e32f8591c1e330231bf41e07d. service=AccessControlService 2023-07-20 07:10:24,998 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-20 07:10:24,998 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table acl a99cc01e32f8591c1e330231bf41e07d 2023-07-20 07:10:24,998 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:acl,,1689837024458.a99cc01e32f8591c1e330231bf41e07d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-20 07:10:24,998 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for a99cc01e32f8591c1e330231bf41e07d 2023-07-20 07:10:24,998 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for a99cc01e32f8591c1e330231bf41e07d 2023-07-20 07:10:25,010 INFO [StoreOpener-a99cc01e32f8591c1e330231bf41e07d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family l of region a99cc01e32f8591c1e330231bf41e07d 2023-07-20 07:10:25,015 DEBUG [StoreOpener-a99cc01e32f8591c1e330231bf41e07d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/data/hbase/acl/a99cc01e32f8591c1e330231bf41e07d/l 2023-07-20 07:10:25,015 DEBUG [StoreOpener-a99cc01e32f8591c1e330231bf41e07d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/data/hbase/acl/a99cc01e32f8591c1e330231bf41e07d/l 2023-07-20 07:10:25,016 INFO [StoreOpener-a99cc01e32f8591c1e330231bf41e07d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region a99cc01e32f8591c1e330231bf41e07d columnFamilyName l 2023-07-20 07:10:25,023 INFO [StoreOpener-a99cc01e32f8591c1e330231bf41e07d-1] regionserver.HStore(310): Store=a99cc01e32f8591c1e330231bf41e07d/l, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-20 07:10:25,027 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/data/hbase/acl/a99cc01e32f8591c1e330231bf41e07d 2023-07-20 07:10:25,029 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/data/hbase/acl/a99cc01e32f8591c1e330231bf41e07d 2023-07-20 07:10:25,035 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for a99cc01e32f8591c1e330231bf41e07d 2023-07-20 07:10:25,043 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/data/hbase/acl/a99cc01e32f8591c1e330231bf41e07d/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-20 07:10:25,045 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened a99cc01e32f8591c1e330231bf41e07d; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74047777, jitterRate=0.10339786112308502}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-20 07:10:25,045 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for a99cc01e32f8591c1e330231bf41e07d: 2023-07-20 07:10:25,047 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:acl,,1689837024458.a99cc01e32f8591c1e330231bf41e07d., pid=11, masterSystemTime=1689837024966 2023-07-20 07:10:25,055 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:acl,,1689837024458.a99cc01e32f8591c1e330231bf41e07d. 2023-07-20 07:10:25,056 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:acl,,1689837024458.a99cc01e32f8591c1e330231bf41e07d. 2023-07-20 07:10:25,060 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=a99cc01e32f8591c1e330231bf41e07d, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,44955,1689837020792 2023-07-20 07:10:25,061 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:acl,,1689837024458.a99cc01e32f8591c1e330231bf41e07d.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1689837025060"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689837025060"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689837025060"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689837025060"}]},"ts":"1689837025060"} 2023-07-20 07:10:25,079 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=11, resume processing ppid=10 2023-07-20 07:10:25,079 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; OpenRegionProcedure a99cc01e32f8591c1e330231bf41e07d, server=jenkins-hbase4.apache.org,44955,1689837020792 in 262 msec 2023-07-20 07:10:25,085 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=10, resume processing ppid=9 2023-07-20 07:10:25,086 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=10, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=hbase:acl, region=a99cc01e32f8591c1e330231bf41e07d, ASSIGN in 434 msec 2023-07-20 07:10:25,088 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-20 07:10:25,088 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:acl","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689837025088"}]},"ts":"1689837025088"} 2023-07-20 07:10:25,093 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:acl, state=ENABLED in hbase:meta 2023-07-20 07:10:25,098 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-20 07:10:25,099 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_POST_OPERATION 2023-07-20 07:10:25,103 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=9, state=SUCCESS; CreateTableProcedure table=hbase:acl in 633 msec 2023-07-20 07:10:25,598 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-20 07:10:25,599 INFO [master/jenkins-hbase4:0:becomeActiveMaster] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: hbase:acl, procId: 9 completed 2023-07-20 07:10:25,619 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1175): Balancer post startup initialization complete, took 0 seconds 2023-07-20 07:10:26,003 WARN [Thread-383] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-20 07:10:26,325 INFO [Thread-383] log.Slf4jLog(67): jetty-6.1.26 2023-07-20 07:10:26,332 INFO [Thread-383] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/jobhistory to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c07d5e8c-eba2-0ae8-aa3a-b7afa648e7e7/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_45033_jobhistory____kfe0rc/webapp 2023-07-20 07:10:26,507 INFO [Thread-383] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.mapreduce.v2.hs.webapp.HsWebServices as a root resource class 2023-07-20 07:10:26,508 INFO [Thread-383] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.mapreduce.v2.hs.webapp.JAXBContextResolver as a provider class 2023-07-20 07:10:26,508 INFO [Thread-383] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-07-20 07:10:26,511 INFO [Thread-383] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-07-20 07:10:26,577 INFO [Thread-383] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.mapreduce.v2.hs.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-20 07:10:26,847 INFO [Thread-383] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-20 07:10:27,192 INFO [Thread-383] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.mapreduce.v2.hs.webapp.HsWebServices to GuiceManagedComponentProvider with the scope "PerRequest" 2023-07-20 07:10:27,228 INFO [Thread-383] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:45033 2023-07-20 07:10:27,488 WARN [Listener at jenkins-hbase4.apache.org/39485] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-20 07:10:27,860 WARN [Listener at jenkins-hbase4.apache.org/39485] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-07-20 07:10:27,860 INFO [Listener at jenkins-hbase4.apache.org/39485] log.Slf4jLog(67): jetty-6.1.26 2023-07-20 07:10:27,868 INFO [Listener at jenkins-hbase4.apache.org/39485] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/cluster to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c07d5e8c-eba2-0ae8-aa3a-b7afa648e7e7/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_37181_cluster____xqhq72/webapp 2023-07-20 07:10:27,964 INFO [Listener at jenkins-hbase4.apache.org/39485] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.resourcemanager.webapp.JAXBContextResolver as a provider class 2023-07-20 07:10:27,964 INFO [Listener at jenkins-hbase4.apache.org/39485] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.resourcemanager.webapp.RMWebServices as a root resource class 2023-07-20 07:10:27,965 INFO [Listener at jenkins-hbase4.apache.org/39485] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-07-20 07:10:27,965 INFO [Listener at jenkins-hbase4.apache.org/39485] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-07-20 07:10:27,975 INFO [Listener at jenkins-hbase4.apache.org/39485] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.resourcemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-20 07:10:28,214 INFO [Listener at jenkins-hbase4.apache.org/39485] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-20 07:10:28,349 INFO [Listener at jenkins-hbase4.apache.org/39485] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.resourcemanager.webapp.RMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-20 07:10:28,376 INFO [Listener at jenkins-hbase4.apache.org/39485] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:37181 2023-07-20 07:10:29,089 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-20 07:10:29,284 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:acl' 2023-07-20 07:10:29,286 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:meta' 2023-07-20 07:10:29,287 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:namespace' 2023-07-20 07:10:29,296 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.RegionServer.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-07-20 07:10:29,297 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.RegionServer.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase RegionServerObservers 2023-07-20 07:10:29,297 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-07-20 07:10:29,297 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase MasterObservers 2023-07-20 07:10:29,298 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver 2023-07-20 07:10:29,298 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver Metrics about HBase MasterObservers 2023-07-20 07:10:29,298 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-07-20 07:10:29,298 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase RegionObservers 2023-07-20 07:10:29,298 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-07-20 07:10:29,298 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint Metrics about HBase RegionObservers 2023-07-20 07:10:29,399 WARN [Listener at jenkins-hbase4.apache.org/32853] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-20 07:10:29,428 WARN [Listener at jenkins-hbase4.apache.org/32853] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-07-20 07:10:29,429 INFO [Listener at jenkins-hbase4.apache.org/32853] log.Slf4jLog(67): jetty-6.1.26 2023-07-20 07:10:29,441 INFO [Listener at jenkins-hbase4.apache.org/32853] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/node to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c07d5e8c-eba2-0ae8-aa3a-b7afa648e7e7/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_46677_node____4i845u/webapp 2023-07-20 07:10:29,501 INFO [Listener at jenkins-hbase4.apache.org/32853] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices as a root resource class 2023-07-20 07:10:29,501 INFO [Listener at jenkins-hbase4.apache.org/32853] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-07-20 07:10:29,501 INFO [Listener at jenkins-hbase4.apache.org/32853] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver as a provider class 2023-07-20 07:10:29,501 INFO [Listener at jenkins-hbase4.apache.org/32853] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-07-20 07:10:29,509 INFO [Listener at jenkins-hbase4.apache.org/32853] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-20 07:10:29,527 INFO [Listener at jenkins-hbase4.apache.org/32853] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-20 07:10:29,627 INFO [Listener at jenkins-hbase4.apache.org/32853] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-20 07:10:29,641 INFO [Listener at jenkins-hbase4.apache.org/32853] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:46677 2023-07-20 07:10:29,928 WARN [Listener at jenkins-hbase4.apache.org/33837] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-20 07:10:29,935 WARN [Listener at jenkins-hbase4.apache.org/33837] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-07-20 07:10:29,935 INFO [Listener at jenkins-hbase4.apache.org/33837] log.Slf4jLog(67): jetty-6.1.26 2023-07-20 07:10:29,943 INFO [Listener at jenkins-hbase4.apache.org/33837] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/node to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c07d5e8c-eba2-0ae8-aa3a-b7afa648e7e7/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_36829_node____.mkx7d2/webapp 2023-07-20 07:10:30,024 INFO [Listener at jenkins-hbase4.apache.org/33837] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices as a root resource class 2023-07-20 07:10:30,024 INFO [Listener at jenkins-hbase4.apache.org/33837] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-07-20 07:10:30,024 INFO [Listener at jenkins-hbase4.apache.org/33837] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver as a provider class 2023-07-20 07:10:30,025 INFO [Listener at jenkins-hbase4.apache.org/33837] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-07-20 07:10:30,034 INFO [Listener at jenkins-hbase4.apache.org/33837] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-20 07:10:30,058 INFO [Listener at jenkins-hbase4.apache.org/33837] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-20 07:10:30,157 INFO [Listener at jenkins-hbase4.apache.org/33837] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-20 07:10:30,163 INFO [Listener at jenkins-hbase4.apache.org/33837] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:36829 2023-07-20 07:10:30,192 INFO [Listener at jenkins-hbase4.apache.org/33837] hbase.HBaseTestingUtility(2726): Mini mapreduce cluster started 2023-07-20 07:10:30,194 INFO [Listener at jenkins-hbase4.apache.org/33837] hbase.Waiter(180): Waiting up to [30,000] milli-secs(wait.for.ratio=[1]) 2023-07-20 07:10:30,257 INFO [Listener at jenkins-hbase4.apache.org/33837] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportWithTargetName Thread=706, OpenFileDescriptor=902, MaxFileDescriptor=60000, SystemLoadAverage=273, ProcessCount=176, AvailableMemoryMB=4540 2023-07-20 07:10:30,257 WARN [Listener at jenkins-hbase4.apache.org/33837] hbase.ResourceChecker(130): Thread=706 is superior to 500 2023-07-20 07:10:30,273 DEBUG [Listener at jenkins-hbase4.apache.org/33837] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-07-20 07:10:30,281 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:55446, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-07-20 07:10:30,289 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-07-20 07:10:30,292 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] procedure2.ProcedureExecutor(1029): Stored pid=12, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportWithTargetName 2023-07-20 07:10:30,295 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_PRE_OPERATION 2023-07-20 07:10:30,296 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportWithTargetName" procId is: 12 2023-07-20 07:10:30,299 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-20 07:10:30,300 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-20 07:10:30,305 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/.tmp/data/default/testtb-testExportWithTargetName/d13e9df15600884f95dc00d2b56a243b 2023-07-20 07:10:30,305 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/.tmp/data/default/testtb-testExportWithTargetName/53766270354a2a06a7f98fc68a0a5641 2023-07-20 07:10:30,308 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/.tmp/data/default/testtb-testExportWithTargetName/d13e9df15600884f95dc00d2b56a243b empty. 2023-07-20 07:10:30,308 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/.tmp/data/default/testtb-testExportWithTargetName/53766270354a2a06a7f98fc68a0a5641 empty. 2023-07-20 07:10:30,309 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/.tmp/data/default/testtb-testExportWithTargetName/53766270354a2a06a7f98fc68a0a5641 2023-07-20 07:10:30,310 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/.tmp/data/default/testtb-testExportWithTargetName/d13e9df15600884f95dc00d2b56a243b 2023-07-20 07:10:30,310 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testExportWithTargetName regions 2023-07-20 07:10:30,345 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/.tmp/data/default/testtb-testExportWithTargetName/.tabledesc/.tableinfo.0000000001 2023-07-20 07:10:30,348 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(7675): creating {ENCODED => 53766270354a2a06a7f98fc68a0a5641, NAME => 'testtb-testExportWithTargetName,,1689837030289.53766270354a2a06a7f98fc68a0a5641.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/.tmp 2023-07-20 07:10:30,348 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(7675): creating {ENCODED => d13e9df15600884f95dc00d2b56a243b, NAME => 'testtb-testExportWithTargetName,1,1689837030289.d13e9df15600884f95dc00d2b56a243b.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/.tmp 2023-07-20 07:10:30,384 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,,1689837030289.53766270354a2a06a7f98fc68a0a5641.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-20 07:10:30,386 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,1,1689837030289.d13e9df15600884f95dc00d2b56a243b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-20 07:10:30,387 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1604): Closing 53766270354a2a06a7f98fc68a0a5641, disabling compactions & flushes 2023-07-20 07:10:30,387 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1604): Closing d13e9df15600884f95dc00d2b56a243b, disabling compactions & flushes 2023-07-20 07:10:30,387 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,,1689837030289.53766270354a2a06a7f98fc68a0a5641. 2023-07-20 07:10:30,387 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,1,1689837030289.d13e9df15600884f95dc00d2b56a243b. 2023-07-20 07:10:30,387 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,,1689837030289.53766270354a2a06a7f98fc68a0a5641. 2023-07-20 07:10:30,387 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,1,1689837030289.d13e9df15600884f95dc00d2b56a243b. 2023-07-20 07:10:30,387 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,,1689837030289.53766270354a2a06a7f98fc68a0a5641. after waiting 0 ms 2023-07-20 07:10:30,387 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,,1689837030289.53766270354a2a06a7f98fc68a0a5641. 2023-07-20 07:10:30,387 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,1,1689837030289.d13e9df15600884f95dc00d2b56a243b. after waiting 0 ms 2023-07-20 07:10:30,387 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,,1689837030289.53766270354a2a06a7f98fc68a0a5641. 2023-07-20 07:10:30,387 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,1,1689837030289.d13e9df15600884f95dc00d2b56a243b. 2023-07-20 07:10:30,387 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1558): Region close journal for 53766270354a2a06a7f98fc68a0a5641: 2023-07-20 07:10:30,387 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,1,1689837030289.d13e9df15600884f95dc00d2b56a243b. 2023-07-20 07:10:30,388 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1558): Region close journal for d13e9df15600884f95dc00d2b56a243b: 2023-07-20 07:10:30,392 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_ADD_TO_META 2023-07-20 07:10:30,393 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,,1689837030289.53766270354a2a06a7f98fc68a0a5641.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689837030393"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689837030393"}]},"ts":"1689837030393"} 2023-07-20 07:10:30,394 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,1,1689837030289.d13e9df15600884f95dc00d2b56a243b.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689837030393"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689837030393"}]},"ts":"1689837030393"} 2023-07-20 07:10:30,403 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-20 07:10:30,446 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-20 07:10:30,448 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-20 07:10:30,449 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689837030449"}]},"ts":"1689837030449"} 2023-07-20 07:10:30,452 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=ENABLING in hbase:meta 2023-07-20 07:10:30,457 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-20 07:10:30,459 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-20 07:10:30,459 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-20 07:10:30,459 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-20 07:10:30,459 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-20 07:10:30,460 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=53766270354a2a06a7f98fc68a0a5641, ASSIGN}, {pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=d13e9df15600884f95dc00d2b56a243b, ASSIGN}] 2023-07-20 07:10:30,463 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=53766270354a2a06a7f98fc68a0a5641, ASSIGN 2023-07-20 07:10:30,463 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=d13e9df15600884f95dc00d2b56a243b, ASSIGN 2023-07-20 07:10:30,464 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=d13e9df15600884f95dc00d2b56a243b, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,44955,1689837020792; forceNewPlan=false, retain=false 2023-07-20 07:10:30,464 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=53766270354a2a06a7f98fc68a0a5641, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,44777,1689837020621; forceNewPlan=false, retain=false 2023-07-20 07:10:30,605 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-20 07:10:30,614 INFO [jenkins-hbase4:37415] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-20 07:10:30,617 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=d13e9df15600884f95dc00d2b56a243b, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,44955,1689837020792 2023-07-20 07:10:30,617 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=53766270354a2a06a7f98fc68a0a5641, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,44777,1689837020621 2023-07-20 07:10:30,617 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,1,1689837030289.d13e9df15600884f95dc00d2b56a243b.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689837030617"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689837030617"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689837030617"}]},"ts":"1689837030617"} 2023-07-20 07:10:30,617 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,,1689837030289.53766270354a2a06a7f98fc68a0a5641.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689837030617"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689837030617"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689837030617"}]},"ts":"1689837030617"} 2023-07-20 07:10:30,620 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=15, ppid=14, state=RUNNABLE; OpenRegionProcedure d13e9df15600884f95dc00d2b56a243b, server=jenkins-hbase4.apache.org,44955,1689837020792}] 2023-07-20 07:10:30,622 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=16, ppid=13, state=RUNNABLE; OpenRegionProcedure 53766270354a2a06a7f98fc68a0a5641, server=jenkins-hbase4.apache.org,44777,1689837020621}] 2023-07-20 07:10:30,781 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,44777,1689837020621 2023-07-20 07:10:30,781 DEBUG [RSProcedureDispatcher-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-20 07:10:30,783 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportWithTargetName,1,1689837030289.d13e9df15600884f95dc00d2b56a243b. 2023-07-20 07:10:30,785 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => d13e9df15600884f95dc00d2b56a243b, NAME => 'testtb-testExportWithTargetName,1,1689837030289.d13e9df15600884f95dc00d2b56a243b.', STARTKEY => '1', ENDKEY => ''} 2023-07-20 07:10:30,785 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:57190, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-20 07:10:30,786 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportWithTargetName,1,1689837030289.d13e9df15600884f95dc00d2b56a243b. service=AccessControlService 2023-07-20 07:10:30,786 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-20 07:10:30,786 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportWithTargetName d13e9df15600884f95dc00d2b56a243b 2023-07-20 07:10:30,786 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,1,1689837030289.d13e9df15600884f95dc00d2b56a243b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-20 07:10:30,786 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for d13e9df15600884f95dc00d2b56a243b 2023-07-20 07:10:30,787 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for d13e9df15600884f95dc00d2b56a243b 2023-07-20 07:10:30,791 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportWithTargetName,,1689837030289.53766270354a2a06a7f98fc68a0a5641. 2023-07-20 07:10:30,791 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 53766270354a2a06a7f98fc68a0a5641, NAME => 'testtb-testExportWithTargetName,,1689837030289.53766270354a2a06a7f98fc68a0a5641.', STARTKEY => '', ENDKEY => '1'} 2023-07-20 07:10:30,792 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportWithTargetName,,1689837030289.53766270354a2a06a7f98fc68a0a5641. service=AccessControlService 2023-07-20 07:10:30,792 INFO [StoreOpener-d13e9df15600884f95dc00d2b56a243b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region d13e9df15600884f95dc00d2b56a243b 2023-07-20 07:10:30,792 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-20 07:10:30,792 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportWithTargetName 53766270354a2a06a7f98fc68a0a5641 2023-07-20 07:10:30,792 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,,1689837030289.53766270354a2a06a7f98fc68a0a5641.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-20 07:10:30,792 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 53766270354a2a06a7f98fc68a0a5641 2023-07-20 07:10:30,792 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 53766270354a2a06a7f98fc68a0a5641 2023-07-20 07:10:30,794 DEBUG [StoreOpener-d13e9df15600884f95dc00d2b56a243b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/data/default/testtb-testExportWithTargetName/d13e9df15600884f95dc00d2b56a243b/cf 2023-07-20 07:10:30,794 INFO [StoreOpener-53766270354a2a06a7f98fc68a0a5641-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 53766270354a2a06a7f98fc68a0a5641 2023-07-20 07:10:30,795 DEBUG [StoreOpener-d13e9df15600884f95dc00d2b56a243b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/data/default/testtb-testExportWithTargetName/d13e9df15600884f95dc00d2b56a243b/cf 2023-07-20 07:10:30,797 DEBUG [StoreOpener-53766270354a2a06a7f98fc68a0a5641-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/data/default/testtb-testExportWithTargetName/53766270354a2a06a7f98fc68a0a5641/cf 2023-07-20 07:10:30,798 DEBUG [StoreOpener-53766270354a2a06a7f98fc68a0a5641-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/data/default/testtb-testExportWithTargetName/53766270354a2a06a7f98fc68a0a5641/cf 2023-07-20 07:10:30,801 INFO [StoreOpener-53766270354a2a06a7f98fc68a0a5641-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 53766270354a2a06a7f98fc68a0a5641 columnFamilyName cf 2023-07-20 07:10:30,801 INFO [StoreOpener-d13e9df15600884f95dc00d2b56a243b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d13e9df15600884f95dc00d2b56a243b columnFamilyName cf 2023-07-20 07:10:30,805 INFO [StoreOpener-53766270354a2a06a7f98fc68a0a5641-1] regionserver.HStore(310): Store=53766270354a2a06a7f98fc68a0a5641/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-20 07:10:30,807 INFO [StoreOpener-d13e9df15600884f95dc00d2b56a243b-1] regionserver.HStore(310): Store=d13e9df15600884f95dc00d2b56a243b/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-20 07:10:30,810 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/data/default/testtb-testExportWithTargetName/d13e9df15600884f95dc00d2b56a243b 2023-07-20 07:10:30,810 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/data/default/testtb-testExportWithTargetName/53766270354a2a06a7f98fc68a0a5641 2023-07-20 07:10:30,810 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/data/default/testtb-testExportWithTargetName/d13e9df15600884f95dc00d2b56a243b 2023-07-20 07:10:30,812 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/data/default/testtb-testExportWithTargetName/53766270354a2a06a7f98fc68a0a5641 2023-07-20 07:10:30,817 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for d13e9df15600884f95dc00d2b56a243b 2023-07-20 07:10:30,827 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/data/default/testtb-testExportWithTargetName/d13e9df15600884f95dc00d2b56a243b/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-20 07:10:30,827 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 53766270354a2a06a7f98fc68a0a5641 2023-07-20 07:10:30,828 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened d13e9df15600884f95dc00d2b56a243b; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73024869, jitterRate=0.0881553441286087}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-20 07:10:30,828 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for d13e9df15600884f95dc00d2b56a243b: 2023-07-20 07:10:30,830 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportWithTargetName,1,1689837030289.d13e9df15600884f95dc00d2b56a243b., pid=15, masterSystemTime=1689837030775 2023-07-20 07:10:30,838 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportWithTargetName,1,1689837030289.d13e9df15600884f95dc00d2b56a243b. 2023-07-20 07:10:30,838 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportWithTargetName,1,1689837030289.d13e9df15600884f95dc00d2b56a243b. 2023-07-20 07:10:30,840 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=d13e9df15600884f95dc00d2b56a243b, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,44955,1689837020792 2023-07-20 07:10:30,840 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportWithTargetName,1,1689837030289.d13e9df15600884f95dc00d2b56a243b.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689837030839"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689837030839"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689837030839"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689837030839"}]},"ts":"1689837030839"} 2023-07-20 07:10:30,841 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/data/default/testtb-testExportWithTargetName/53766270354a2a06a7f98fc68a0a5641/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-20 07:10:30,842 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 53766270354a2a06a7f98fc68a0a5641; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67003246, jitterRate=-0.0015738308429718018}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-20 07:10:30,843 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 53766270354a2a06a7f98fc68a0a5641: 2023-07-20 07:10:30,844 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportWithTargetName,,1689837030289.53766270354a2a06a7f98fc68a0a5641., pid=16, masterSystemTime=1689837030780 2023-07-20 07:10:30,851 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=15, resume processing ppid=14 2023-07-20 07:10:30,856 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=15, ppid=14, state=SUCCESS; OpenRegionProcedure d13e9df15600884f95dc00d2b56a243b, server=jenkins-hbase4.apache.org,44955,1689837020792 in 224 msec 2023-07-20 07:10:30,858 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=14, ppid=12, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=d13e9df15600884f95dc00d2b56a243b, ASSIGN in 396 msec 2023-07-20 07:10:30,860 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportWithTargetName,,1689837030289.53766270354a2a06a7f98fc68a0a5641. 2023-07-20 07:10:30,861 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportWithTargetName,,1689837030289.53766270354a2a06a7f98fc68a0a5641. 2023-07-20 07:10:30,862 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=53766270354a2a06a7f98fc68a0a5641, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,44777,1689837020621 2023-07-20 07:10:30,862 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportWithTargetName,,1689837030289.53766270354a2a06a7f98fc68a0a5641.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689837030862"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689837030862"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689837030862"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689837030862"}]},"ts":"1689837030862"} 2023-07-20 07:10:30,872 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=16, resume processing ppid=13 2023-07-20 07:10:30,872 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=13, state=SUCCESS; OpenRegionProcedure 53766270354a2a06a7f98fc68a0a5641, server=jenkins-hbase4.apache.org,44777,1689837020621 in 245 msec 2023-07-20 07:10:30,876 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=13, resume processing ppid=12 2023-07-20 07:10:30,878 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=13, ppid=12, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=53766270354a2a06a7f98fc68a0a5641, ASSIGN in 412 msec 2023-07-20 07:10:30,879 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-20 07:10:30,880 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689837030879"}]},"ts":"1689837030879"} 2023-07-20 07:10:30,882 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=ENABLED in hbase:meta 2023-07-20 07:10:30,885 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_POST_OPERATION 2023-07-20 07:10:30,890 DEBUG [PEWorker-3] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportWithTargetName jenkins: RWXCA 2023-07-20 07:10:30,896 DEBUG [PEWorker-3] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-20 07:10:30,899 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:57864, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-20 07:10:30,904 DEBUG [hconnection-0x7623e369-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-20 07:10:30,907 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:40282, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.2 (auth:SIMPLE), service=ClientService 2023-07-20 07:10:30,908 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-20 07:10:30,916 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=44955] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-07-20 07:10:30,954 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): regionserver:44777-0x10181911f0f0001, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-20 07:10:30,954 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): regionserver:44955-0x10181911f0f0003, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-20 07:10:30,954 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): regionserver:45099-0x10181911f0f0002, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-20 07:10:30,956 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): master:37415-0x10181911f0f0000, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-20 07:10:30,956 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): master:37415-0x10181911f0f0000, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-20 07:10:30,970 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-07-20 07:10:30,970 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-07-20 07:10:30,970 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-07-20 07:10:30,971 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-07-20 07:10:30,974 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=12, state=SUCCESS; CreateTableProcedure table=testtb-testExportWithTargetName in 682 msec 2023-07-20 07:10:31,410 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-20 07:10:31,411 INFO [Listener at jenkins-hbase4.apache.org/33837] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportWithTargetName, procId: 12 completed 2023-07-20 07:10:31,423 DEBUG [Listener at jenkins-hbase4.apache.org/33837] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportWithTargetName 2023-07-20 07:10:31,424 DEBUG [Listener at jenkins-hbase4.apache.org/33837] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportWithTargetName,,1689837030289.53766270354a2a06a7f98fc68a0a5641. 2023-07-20 07:10:31,427 INFO [Listener at jenkins-hbase4.apache.org/33837] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-20 07:10:31,464 DEBUG [hconnection-0x2a6c5873-shared-pool-4] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-20 07:10:31,484 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:57202, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-20 07:10:31,489 DEBUG [hconnection-0x2a6c5873-shared-pool-5] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-20 07:10:31,495 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:57868, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-20 07:10:31,518 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-20 07:10:31,518 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689837031518 (current time:1689837031518). 2023-07-20 07:10:31,519 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-20 07:10:31,519 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] zookeeper.ReadOnlyZKClient(139): Connect 0x0a994c64 to 127.0.0.1:58010 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-20 07:10:31,532 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@105f3e75, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-20 07:10:31,534 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-20 07:10:31,538 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:40290, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-20 07:10:31,540 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0a994c64 to 127.0.0.1:58010 2023-07-20 07:10:31,540 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-20 07:10:31,542 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] zookeeper.ReadOnlyZKClient(139): Connect 0x109d6ffa to 127.0.0.1:58010 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-20 07:10:31,553 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@58a3a815, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-20 07:10:31,559 DEBUG [hconnection-0x504171c0-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-20 07:10:31,560 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:40304, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-20 07:10:31,569 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-20 07:10:31,579 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:57872, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-20 07:10:31,581 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x109d6ffa to 127.0.0.1:58010 2023-07-20 07:10:31,581 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-20 07:10:31,581 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-07-20 07:10:31,623 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-20 07:10:31,624 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-20 07:10:31,658 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] procedure2.ProcedureExecutor(1029): Stored pid=17, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-20 07:10:31,660 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=17, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-20 07:10:31,662 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=17, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE; timeout=600000, timestamp=1689837631662 2023-07-20 07:10:31,666 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-20 07:10:31,667 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName 2023-07-20 07:10:31,670 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=17, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-20 07:10:31,674 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=17, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE in 24 msec 2023-07-20 07:10:31,676 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-20 07:10:31,677 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-20 07:10:31,678 DEBUG [Listener at jenkins-hbase4.apache.org/33837] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-20 07:10:31,678 DEBUG [Listener at jenkins-hbase4.apache.org/33837] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-20 07:10:31,679 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=18, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED; timeout=600000, timestamp=1689837631679 2023-07-20 07:10:31,735 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportWithTargetName 2023-07-20 07:10:31,736 INFO [(jenkins-hbase4.apache.org,37415,1689837019114)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportWithTargetName' 2023-07-20 07:10:31,736 DEBUG [(jenkins-hbase4.apache.org,37415,1689837019114)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-20 07:10:31,737 DEBUG [(jenkins-hbase4.apache.org,37415,1689837019114)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' 2023-07-20 07:10:31,737 DEBUG [(jenkins-hbase4.apache.org,37415,1689837019114)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportWithTargetName', kicking off acquire phase on members. 2023-07-20 07:10:31,738 DEBUG [(jenkins-hbase4.apache.org,37415,1689837019114)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37415-0x10181911f0f0000, quorum=127.0.0.1:58010, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-20 07:10:31,738 DEBUG [(jenkins-hbase4.apache.org,37415,1689837019114)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-20 07:10:31,748 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): regionserver:45099-0x10181911f0f0002, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 07:10:31,748 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): regionserver:44955-0x10181911f0f0003, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 07:10:31,748 DEBUG [(jenkins-hbase4.apache.org,37415,1689837019114)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44777,1689837020621 2023-07-20 07:10:31,748 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): regionserver:44777-0x10181911f0f0001, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 07:10:31,748 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 07:10:31,748 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 07:10:31,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 07:10:31,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 07:10:31,749 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 07:10:31,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 07:10:31,749 DEBUG [(jenkins-hbase4.apache.org,37415,1689837019114)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37415-0x10181911f0f0000, quorum=127.0.0.1:58010, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44777,1689837020621 2023-07-20 07:10:31,750 DEBUG [(jenkins-hbase4.apache.org,37415,1689837019114)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44955,1689837020792 2023-07-20 07:10:31,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-20 07:10:31,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-20 07:10:31,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-20 07:10:31,751 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44955-0x10181911f0f0003, quorum=127.0.0.1:58010, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-20 07:10:31,752 DEBUG [(jenkins-hbase4.apache.org,37415,1689837019114)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37415-0x10181911f0f0000, quorum=127.0.0.1:58010, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44955,1689837020792 2023-07-20 07:10:31,752 DEBUG [(jenkins-hbase4.apache.org,37415,1689837019114)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-20 07:10:31,752 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44777-0x10181911f0f0001, quorum=127.0.0.1:58010, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-20 07:10:31,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-07-20 07:10:31,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-20 07:10:31,755 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45099-0x10181911f0f0002, quorum=127.0.0.1:58010, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-20 07:10:31,755 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-20 07:10:31,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-07-20 07:10:31,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-20 07:10:31,755 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-20 07:10:31,756 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-07-20 07:10:31,756 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-20 07:10:31,758 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-20 07:10:31,759 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-07-20 07:10:31,763 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-07-20 07:10:31,763 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-07-20 07:10:31,763 DEBUG [member: 'jenkins-hbase4.apache.org,45099,1689837020733' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-20 07:10:31,764 DEBUG [member: 'jenkins-hbase4.apache.org,45099,1689837020733' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-20 07:10:31,764 DEBUG [member: 'jenkins-hbase4.apache.org,44955,1689837020792' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-20 07:10:31,764 DEBUG [member: 'jenkins-hbase4.apache.org,44955,1689837020792' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-20 07:10:31,765 DEBUG [member: 'jenkins-hbase4.apache.org,45099,1689837020733' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-20 07:10:31,765 DEBUG [member: 'jenkins-hbase4.apache.org,44955,1689837020792' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-20 07:10:31,766 DEBUG [member: 'jenkins-hbase4.apache.org,44955,1689837020792' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-07-20 07:10:31,765 DEBUG [member: 'jenkins-hbase4.apache.org,45099,1689837020733' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-07-20 07:10:31,766 DEBUG [member: 'jenkins-hbase4.apache.org,44955,1689837020792' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44955,1689837020792' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-07-20 07:10:31,766 DEBUG [member: 'jenkins-hbase4.apache.org,45099,1689837020733' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45099,1689837020733' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-07-20 07:10:31,766 DEBUG [member: 'jenkins-hbase4.apache.org,44777,1689837020621' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-20 07:10:31,767 DEBUG [member: 'jenkins-hbase4.apache.org,44777,1689837020621' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-20 07:10:31,769 DEBUG [member: 'jenkins-hbase4.apache.org,44777,1689837020621' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-20 07:10:31,770 DEBUG [member: 'jenkins-hbase4.apache.org,44777,1689837020621' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-07-20 07:10:31,770 DEBUG [member: 'jenkins-hbase4.apache.org,44777,1689837020621' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44777,1689837020621' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-07-20 07:10:31,776 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): master:37415-0x10181911f0f0000, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44955,1689837020792 2023-07-20 07:10:31,776 DEBUG [member: 'jenkins-hbase4.apache.org,44955,1689837020792' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-20 07:10:31,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44955,1689837020792 2023-07-20 07:10:31,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-20 07:10:31,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-20 07:10:31,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-20 07:10:31,778 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-20 07:10:31,778 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-20 07:10:31,778 DEBUG [Listener at jenkins-hbase4.apache.org/33837] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-20 07:10:31,779 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44955,1689837020792 2023-07-20 07:10:31,779 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45099,1689837020733 2023-07-20 07:10:31,780 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-20 07:10:31,781 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44955,1689837020792' joining acquired barrier for procedure 'emptySnaptb0-testExportWithTargetName' on coordinator 2023-07-20 07:10:31,781 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6570ed5c[Count = 1] remaining members to acquire global barrier 2023-07-20 07:10:31,782 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-20 07:10:31,783 DEBUG [member: 'jenkins-hbase4.apache.org,45099,1689837020733' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-20 07:10:31,784 DEBUG [member: 'jenkins-hbase4.apache.org,44955,1689837020792' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44955-0x10181911f0f0003, quorum=127.0.0.1:58010, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-20 07:10:31,785 DEBUG [member: 'jenkins-hbase4.apache.org,44955,1689837020792' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-20 07:10:31,785 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-20 07:10:31,785 DEBUG [member: 'jenkins-hbase4.apache.org,45099,1689837020733' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45099-0x10181911f0f0002, quorum=127.0.0.1:58010, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-20 07:10:31,785 DEBUG [member: 'jenkins-hbase4.apache.org,45099,1689837020733' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-20 07:10:31,785 DEBUG [Listener at jenkins-hbase4.apache.org/33837] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-20 07:10:31,786 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): master:37415-0x10181911f0f0000, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44777,1689837020621 2023-07-20 07:10:31,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44777,1689837020621 2023-07-20 07:10:31,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-20 07:10:31,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-20 07:10:31,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-20 07:10:31,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-20 07:10:31,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-20 07:10:31,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44955,1689837020792 2023-07-20 07:10:31,789 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44777,1689837020621 2023-07-20 07:10:31,789 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45099,1689837020733 2023-07-20 07:10:31,790 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-20 07:10:31,791 DEBUG [member: 'jenkins-hbase4.apache.org,44777,1689837020621' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-20 07:10:31,791 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44777,1689837020621' joining acquired barrier for procedure 'emptySnaptb0-testExportWithTargetName' on coordinator 2023-07-20 07:10:31,791 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6570ed5c[Count = 0] remaining members to acquire global barrier 2023-07-20 07:10:31,792 DEBUG [(jenkins-hbase4.apache.org,37415,1689837019114)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportWithTargetName' starting 'in-barrier' execution. 2023-07-20 07:10:31,792 DEBUG [(jenkins-hbase4.apache.org,37415,1689837019114)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-20 07:10:31,792 DEBUG [member: 'jenkins-hbase4.apache.org,44777,1689837020621' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44777-0x10181911f0f0001, quorum=127.0.0.1:58010, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-20 07:10:31,792 DEBUG [member: 'jenkins-hbase4.apache.org,44777,1689837020621' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-20 07:10:31,800 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): regionserver:45099-0x10181911f0f0002, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-20 07:10:31,800 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-20 07:10:31,800 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-20 07:10:31,802 DEBUG [(jenkins-hbase4.apache.org,37415,1689837019114)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37415-0x10181911f0f0000, quorum=127.0.0.1:58010, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44955,1689837020792 2023-07-20 07:10:31,803 DEBUG [(jenkins-hbase4.apache.org,37415,1689837019114)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37415-0x10181911f0f0000, quorum=127.0.0.1:58010, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44777,1689837020621 2023-07-20 07:10:31,803 DEBUG [(jenkins-hbase4.apache.org,37415,1689837019114)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-20 07:10:31,803 DEBUG [member: 'jenkins-hbase4.apache.org,45099,1689837020733' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-20 07:10:31,803 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): regionserver:44955-0x10181911f0f0003, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-20 07:10:31,803 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): regionserver:44777-0x10181911f0f0001, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-20 07:10:31,803 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-20 07:10:31,803 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-20 07:10:31,803 DEBUG [member: 'jenkins-hbase4.apache.org,45099,1689837020733' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-07-20 07:10:31,803 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-20 07:10:31,803 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-20 07:10:31,803 DEBUG [member: 'jenkins-hbase4.apache.org,45099,1689837020733' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,45099,1689837020733' in zk 2023-07-20 07:10:31,803 DEBUG [member: 'jenkins-hbase4.apache.org,44955,1689837020792' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-20 07:10:31,803 DEBUG [member: 'jenkins-hbase4.apache.org,44777,1689837020621' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-20 07:10:31,807 DEBUG [member: 'jenkins-hbase4.apache.org,44777,1689837020621' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-20 07:10:31,807 DEBUG [rs(jenkins-hbase4.apache.org,44777,1689837020621)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,,1689837030289.53766270354a2a06a7f98fc68a0a5641. 2023-07-20 07:10:31,807 DEBUG [member: 'jenkins-hbase4.apache.org,44777,1689837020621' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-20 07:10:31,807 DEBUG [rs(jenkins-hbase4.apache.org,44777,1689837020621)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,,1689837030289.53766270354a2a06a7f98fc68a0a5641. started... 2023-07-20 07:10:31,810 DEBUG [rs(jenkins-hbase4.apache.org,44777,1689837020621)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 53766270354a2a06a7f98fc68a0a5641: 2023-07-20 07:10:31,812 DEBUG [rs(jenkins-hbase4.apache.org,44777,1689837020621)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,,1689837030289.53766270354a2a06a7f98fc68a0a5641.' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-07-20 07:10:31,816 DEBUG [member: 'jenkins-hbase4.apache.org,44955,1689837020792' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-20 07:10:31,822 DEBUG [member: 'jenkins-hbase4.apache.org,44955,1689837020792' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-20 07:10:31,822 DEBUG [rs(jenkins-hbase4.apache.org,44955,1689837020792)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,1,1689837030289.d13e9df15600884f95dc00d2b56a243b. 2023-07-20 07:10:31,822 DEBUG [member: 'jenkins-hbase4.apache.org,45099,1689837020733' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-07-20 07:10:31,822 DEBUG [rs(jenkins-hbase4.apache.org,44955,1689837020792)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,1,1689837030289.d13e9df15600884f95dc00d2b56a243b. started... 2023-07-20 07:10:31,822 DEBUG [member: 'jenkins-hbase4.apache.org,45099,1689837020733' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-20 07:10:31,822 DEBUG [member: 'jenkins-hbase4.apache.org,45099,1689837020733' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-07-20 07:10:31,824 DEBUG [rs(jenkins-hbase4.apache.org,44955,1689837020792)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for d13e9df15600884f95dc00d2b56a243b: 2023-07-20 07:10:31,824 DEBUG [rs(jenkins-hbase4.apache.org,44955,1689837020792)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,1,1689837030289.d13e9df15600884f95dc00d2b56a243b.' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-07-20 07:10:31,828 DEBUG [rs(jenkins-hbase4.apache.org,44955,1689837020792)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-20 07:10:31,834 DEBUG [rs(jenkins-hbase4.apache.org,44955,1689837020792)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-20 07:10:31,835 DEBUG [rs(jenkins-hbase4.apache.org,44777,1689837020621)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-20 07:10:31,835 DEBUG [rs(jenkins-hbase4.apache.org,44777,1689837020621)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-20 07:10:31,933 DEBUG [rs(jenkins-hbase4.apache.org,44777,1689837020621)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,,1689837030289.53766270354a2a06a7f98fc68a0a5641. completed. 2023-07-20 07:10:31,934 DEBUG [rs(jenkins-hbase4.apache.org,44777,1689837020621)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,,1689837030289.53766270354a2a06a7f98fc68a0a5641. 2023-07-20 07:10:31,934 DEBUG [rs(jenkins-hbase4.apache.org,44955,1689837020792)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,1,1689837030289.d13e9df15600884f95dc00d2b56a243b. completed. 2023-07-20 07:10:31,934 DEBUG [rs(jenkins-hbase4.apache.org,44955,1689837020792)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,1,1689837030289.d13e9df15600884f95dc00d2b56a243b. 2023-07-20 07:10:31,934 DEBUG [member: 'jenkins-hbase4.apache.org,44777,1689837020621' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-20 07:10:31,934 DEBUG [member: 'jenkins-hbase4.apache.org,44955,1689837020792' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-20 07:10:31,935 DEBUG [member: 'jenkins-hbase4.apache.org,44955,1689837020792' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-20 07:10:31,935 DEBUG [member: 'jenkins-hbase4.apache.org,44777,1689837020621' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-20 07:10:31,935 DEBUG [member: 'jenkins-hbase4.apache.org,44955,1689837020792' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,44955,1689837020792 2023-07-20 07:10:31,935 DEBUG [member: 'jenkins-hbase4.apache.org,44777,1689837020621' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,44777,1689837020621 2023-07-20 07:10:31,935 DEBUG [member: 'jenkins-hbase4.apache.org,44955,1689837020792' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-07-20 07:10:31,935 DEBUG [member: 'jenkins-hbase4.apache.org,44777,1689837020621' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-07-20 07:10:31,935 DEBUG [member: 'jenkins-hbase4.apache.org,44777,1689837020621' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,44777,1689837020621' in zk 2023-07-20 07:10:31,935 DEBUG [member: 'jenkins-hbase4.apache.org,44955,1689837020792' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,44955,1689837020792' in zk 2023-07-20 07:10:31,938 DEBUG [member: 'jenkins-hbase4.apache.org,44777,1689837020621' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-07-20 07:10:31,938 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): master:37415-0x10181911f0f0000, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44777,1689837020621 2023-07-20 07:10:31,938 DEBUG [member: 'jenkins-hbase4.apache.org,44777,1689837020621' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-20 07:10:31,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44777,1689837020621 2023-07-20 07:10:31,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-20 07:10:31,938 DEBUG [member: 'jenkins-hbase4.apache.org,44777,1689837020621' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-07-20 07:10:31,941 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-20 07:10:31,941 DEBUG [member: 'jenkins-hbase4.apache.org,44955,1689837020792' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-07-20 07:10:31,941 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): master:37415-0x10181911f0f0000, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44955,1689837020792 2023-07-20 07:10:31,941 DEBUG [member: 'jenkins-hbase4.apache.org,44955,1689837020792' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-20 07:10:31,941 DEBUG [member: 'jenkins-hbase4.apache.org,44955,1689837020792' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-07-20 07:10:31,942 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-20 07:10:31,943 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-20 07:10:31,943 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-20 07:10:31,944 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44955,1689837020792 2023-07-20 07:10:31,944 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44777,1689837020621 2023-07-20 07:10:31,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45099,1689837020733 2023-07-20 07:10:31,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-20 07:10:31,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-20 07:10:31,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44955,1689837020792 2023-07-20 07:10:31,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44777,1689837020621 2023-07-20 07:10:31,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45099,1689837020733 2023-07-20 07:10:31,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,44777,1689837020621': 2023-07-20 07:10:31,949 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44777,1689837020621' released barrier for procedure'emptySnaptb0-testExportWithTargetName', counting down latch. Waiting for 1 more 2023-07-20 07:10:31,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44955,1689837020792 2023-07-20 07:10:31,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-20 07:10:31,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-20 07:10:31,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-20 07:10:31,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-20 07:10:31,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-20 07:10:31,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44955,1689837020792 2023-07-20 07:10:31,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44777,1689837020621 2023-07-20 07:10:31,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45099,1689837020733 2023-07-20 07:10:31,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-20 07:10:31,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-20 07:10:31,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44955,1689837020792 2023-07-20 07:10:31,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44777,1689837020621 2023-07-20 07:10:31,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45099,1689837020733 2023-07-20 07:10:31,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,44955,1689837020792': 2023-07-20 07:10:31,955 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44955,1689837020792' released barrier for procedure'emptySnaptb0-testExportWithTargetName', counting down latch. Waiting for 0 more 2023-07-20 07:10:31,955 INFO [(jenkins-hbase4.apache.org,37415,1689837019114)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportWithTargetName' execution completed 2023-07-20 07:10:31,955 DEBUG [(jenkins-hbase4.apache.org,37415,1689837019114)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-20 07:10:31,955 DEBUG [(jenkins-hbase4.apache.org,37415,1689837019114)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-20 07:10:31,956 DEBUG [(jenkins-hbase4.apache.org,37415,1689837019114)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportWithTargetName 2023-07-20 07:10:31,956 INFO [(jenkins-hbase4.apache.org,37415,1689837019114)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportWithTargetNameincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-20 07:10:31,960 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): regionserver:44777-0x10181911f0f0001, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-20 07:10:31,960 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): regionserver:45099-0x10181911f0f0002, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-20 07:10:31,960 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): master:37415-0x10181911f0f0000, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-20 07:10:31,960 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-20 07:10:31,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-20 07:10:31,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-20 07:10:31,960 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): regionserver:45099-0x10181911f0f0002, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 07:10:31,960 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-20 07:10:31,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-20 07:10:31,960 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): regionserver:44777-0x10181911f0f0001, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 07:10:31,960 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): regionserver:44955-0x10181911f0f0003, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-20 07:10:31,961 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): regionserver:44955-0x10181911f0f0003, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 07:10:31,961 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-20 07:10:31,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-20 07:10:31,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-20 07:10:31,961 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 07:10:31,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 07:10:31,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-20 07:10:31,961 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 07:10:31,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 07:10:31,962 DEBUG [(jenkins-hbase4.apache.org,37415,1689837019114)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37415-0x10181911f0f0000, quorum=127.0.0.1:58010, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44955,1689837020792 2023-07-20 07:10:31,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-20 07:10:31,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-20 07:10:31,962 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 07:10:31,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 07:10:31,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-20 07:10:31,963 DEBUG [(jenkins-hbase4.apache.org,37415,1689837019114)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37415-0x10181911f0f0000, quorum=127.0.0.1:58010, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44777,1689837020621 2023-07-20 07:10:31,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-20 07:10:31,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-20 07:10:31,964 DEBUG [(jenkins-hbase4.apache.org,37415,1689837019114)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37415-0x10181911f0f0000, quorum=127.0.0.1:58010, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45099,1689837020733 2023-07-20 07:10:31,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-20 07:10:31,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-20 07:10:31,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44955,1689837020792 2023-07-20 07:10:31,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44777,1689837020621 2023-07-20 07:10:31,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45099,1689837020733 2023-07-20 07:10:31,967 DEBUG [(jenkins-hbase4.apache.org,37415,1689837019114)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37415-0x10181911f0f0000, quorum=127.0.0.1:58010, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44955,1689837020792 2023-07-20 07:10:31,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-20 07:10:31,969 DEBUG [(jenkins-hbase4.apache.org,37415,1689837019114)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37415-0x10181911f0f0000, quorum=127.0.0.1:58010, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44777,1689837020621 2023-07-20 07:10:31,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-20 07:10:31,969 DEBUG [(jenkins-hbase4.apache.org,37415,1689837019114)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37415-0x10181911f0f0000, quorum=127.0.0.1:58010, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45099,1689837020733 2023-07-20 07:10:31,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44955,1689837020792 2023-07-20 07:10:31,970 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44777,1689837020621 2023-07-20 07:10:31,970 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45099,1689837020733 2023-07-20 07:10:31,985 DEBUG [Listener at jenkins-hbase4.apache.org/33837] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-20 07:10:31,986 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): master:37415-0x10181911f0f0000, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45099,1689837020733 2023-07-20 07:10:31,986 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): master:37415-0x10181911f0f0000, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-20 07:10:31,986 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): master:37415-0x10181911f0f0000, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44777,1689837020621 2023-07-20 07:10:31,986 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): master:37415-0x10181911f0f0000, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44955,1689837020792 2023-07-20 07:10:31,986 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): regionserver:44955-0x10181911f0f0003, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 07:10:31,986 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): regionserver:44777-0x10181911f0f0001, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 07:10:31,986 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): regionserver:45099-0x10181911f0f0002, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 07:10:31,986 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): regionserver:44955-0x10181911f0f0003, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 07:10:31,986 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): master:37415-0x10181911f0f0000, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-20 07:10:31,987 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 07:10:31,987 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 07:10:31,987 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): regionserver:45099-0x10181911f0f0002, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 07:10:31,986 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): regionserver:44777-0x10181911f0f0001, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 07:10:31,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 07:10:31,987 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 07:10:31,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 07:10:31,987 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportWithTargetName 2023-07-20 07:10:31,987 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): master:37415-0x10181911f0f0000, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45099,1689837020733 2023-07-20 07:10:31,987 DEBUG [(jenkins-hbase4.apache.org,37415,1689837019114)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-20 07:10:31,987 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): master:37415-0x10181911f0f0000, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-20 07:10:31,987 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportWithTargetName 2023-07-20 07:10:31,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 07:10:31,987 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): master:37415-0x10181911f0f0000, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44777,1689837020621 2023-07-20 07:10:31,988 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 90c8eeaaf01a24f585da11044309be71, NAME => 'testtb-testExportWithTargetName,.mob,0.90c8eeaaf01a24f585da11044309be71.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-07-20 07:10:31,988 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): master:37415-0x10181911f0f0000, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44955,1689837020792 2023-07-20 07:10:31,988 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-20 07:10:31,988 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 07:10:31,988 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-20 07:10:31,988 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 07:10:31,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 07:10:31,988 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): master:37415-0x10181911f0f0000, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-20 07:10:31,989 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 07:10:31,988 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-20 07:10:31,989 DEBUG [Listener at jenkins-hbase4.apache.org/33837] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-20 07:10:31,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 07:10:31,989 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): master:37415-0x10181911f0f0000, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-20 07:10:31,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 07:10:31,990 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-07-20 07:10:32,031 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportWithTargetName 2023-07-20 07:10:32,034 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-07-20 07:10:32,090 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName to hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/.hbase-snapshot/emptySnaptb0-testExportWithTargetName 2023-07-20 07:10:32,129 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed 2023-07-20 07:10:32,129 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-07-20 07:10:32,130 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-07-20 07:10:32,130 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName at 1689837031667Completed referencing HFiles for the mob region of table: testtb-testExportWithTargetName at 1689837032031 (+364 ms)Consolidate snapshot: emptySnaptb0-testExportWithTargetName at 1689837032031Loading Region manifests for emptySnaptb0-testExportWithTargetName at 1689837032032 (+1 ms)Writing data manifest for emptySnaptb0-testExportWithTargetName at 1689837032046 (+14 ms)Verifying snapshot: emptySnaptb0-testExportWithTargetName at 1689837032078 (+32 ms)Snapshot emptySnaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed at 1689837032129 (+51 ms) 2023-07-20 07:10:32,134 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=18, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-20 07:10:32,136 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=18, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED in 464 msec 2023-07-20 07:10:32,289 DEBUG [Listener at jenkins-hbase4.apache.org/33837] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-20 07:10:32,293 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-20 07:10:32,293 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-20 07:10:32,308 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44777] regionserver.HRegion(8805): writing data to region testtb-testExportWithTargetName,,1689837030289.53766270354a2a06a7f98fc68a0a5641. with WAL disabled. Data may be lost in the event of a crash. 2023-07-20 07:10:32,311 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44955] regionserver.HRegion(8805): writing data to region testtb-testExportWithTargetName,1,1689837030289.d13e9df15600884f95dc00d2b56a243b. with WAL disabled. Data may be lost in the event of a crash. 2023-07-20 07:10:32,320 DEBUG [Listener at jenkins-hbase4.apache.org/33837] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportWithTargetName 2023-07-20 07:10:32,320 DEBUG [Listener at jenkins-hbase4.apache.org/33837] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportWithTargetName,,1689837030289.53766270354a2a06a7f98fc68a0a5641. 2023-07-20 07:10:32,321 INFO [Listener at jenkins-hbase4.apache.org/33837] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-20 07:10:32,344 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-20 07:10:32,344 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689837032344 (current time:1689837032344). 2023-07-20 07:10:32,344 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-20 07:10:32,344 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] zookeeper.ReadOnlyZKClient(139): Connect 0x56eb8def to 127.0.0.1:58010 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-20 07:10:32,355 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7592bd53, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-20 07:10:32,357 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-20 07:10:32,361 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:40318, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-20 07:10:32,363 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x56eb8def to 127.0.0.1:58010 2023-07-20 07:10:32,363 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-20 07:10:32,364 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] zookeeper.ReadOnlyZKClient(139): Connect 0x55951ad6 to 127.0.0.1:58010 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-20 07:10:32,372 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5f9b617e, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-20 07:10:32,374 DEBUG [hconnection-0x3f0327fb-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-20 07:10:32,377 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:40334, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-20 07:10:32,382 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-20 07:10:32,384 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:57884, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-20 07:10:32,385 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x55951ad6 to 127.0.0.1:58010 2023-07-20 07:10:32,386 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-20 07:10:32,386 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-07-20 07:10:32,387 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-20 07:10:32,387 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-20 07:10:32,391 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] procedure2.ProcedureExecutor(1029): Stored pid=19, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-20 07:10:32,392 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=19, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-20 07:10:32,393 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=19, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE; timeout=600000, timestamp=1689837632393 2023-07-20 07:10:32,393 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-20 07:10:32,393 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName 2023-07-20 07:10:32,395 DEBUG [Listener at jenkins-hbase4.apache.org/33837] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-20 07:10:32,395 DEBUG [Listener at jenkins-hbase4.apache.org/33837] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-20 07:10:32,396 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=20, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-20 07:10:32,396 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=19, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-20 07:10:32,399 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=19, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE in 8 msec 2023-07-20 07:10:32,400 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=20, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-20 07:10:32,402 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=20, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED; timeout=600000, timestamp=1689837632402 2023-07-20 07:10:32,421 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportWithTargetName 2023-07-20 07:10:32,421 INFO [(jenkins-hbase4.apache.org,37415,1689837019114)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportWithTargetName' 2023-07-20 07:10:32,422 DEBUG [(jenkins-hbase4.apache.org,37415,1689837019114)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-20 07:10:32,423 DEBUG [(jenkins-hbase4.apache.org,37415,1689837019114)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportWithTargetName' starting 'acquire' 2023-07-20 07:10:32,423 DEBUG [(jenkins-hbase4.apache.org,37415,1689837019114)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportWithTargetName', kicking off acquire phase on members. 2023-07-20 07:10:32,423 DEBUG [(jenkins-hbase4.apache.org,37415,1689837019114)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37415-0x10181911f0f0000, quorum=127.0.0.1:58010, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-20 07:10:32,423 DEBUG [(jenkins-hbase4.apache.org,37415,1689837019114)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-20 07:10:32,425 DEBUG [(jenkins-hbase4.apache.org,37415,1689837019114)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44777,1689837020621 2023-07-20 07:10:32,425 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): regionserver:44955-0x10181911f0f0003, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 07:10:32,425 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): regionserver:45099-0x10181911f0f0002, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 07:10:32,425 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 07:10:32,425 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): regionserver:44777-0x10181911f0f0001, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 07:10:32,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 07:10:32,425 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 07:10:32,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 07:10:32,425 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 07:10:32,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 07:10:32,425 DEBUG [(jenkins-hbase4.apache.org,37415,1689837019114)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37415-0x10181911f0f0000, quorum=127.0.0.1:58010, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44777,1689837020621 2023-07-20 07:10:32,425 DEBUG [(jenkins-hbase4.apache.org,37415,1689837019114)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44955,1689837020792 2023-07-20 07:10:32,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-20 07:10:32,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-20 07:10:32,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-20 07:10:32,426 DEBUG [(jenkins-hbase4.apache.org,37415,1689837019114)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37415-0x10181911f0f0000, quorum=127.0.0.1:58010, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44955,1689837020792 2023-07-20 07:10:32,426 DEBUG [(jenkins-hbase4.apache.org,37415,1689837019114)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-20 07:10:32,426 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44777-0x10181911f0f0001, quorum=127.0.0.1:58010, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-20 07:10:32,426 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44955-0x10181911f0f0003, quorum=127.0.0.1:58010, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-20 07:10:32,427 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45099-0x10181911f0f0002, quorum=127.0.0.1:58010, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-20 07:10:32,427 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-07-20 07:10:32,427 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-20 07:10:32,427 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-07-20 07:10:32,427 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-20 07:10:32,427 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-07-20 07:10:32,427 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-20 07:10:32,427 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-20 07:10:32,427 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-20 07:10:32,428 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-20 07:10:32,428 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-07-20 07:10:32,428 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-07-20 07:10:32,428 DEBUG [member: 'jenkins-hbase4.apache.org,45099,1689837020733' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-20 07:10:32,428 DEBUG [member: 'jenkins-hbase4.apache.org,44777,1689837020621' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-20 07:10:32,428 DEBUG [member: 'jenkins-hbase4.apache.org,44777,1689837020621' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-20 07:10:32,428 DEBUG [member: 'jenkins-hbase4.apache.org,45099,1689837020733' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-20 07:10:32,429 DEBUG [member: 'jenkins-hbase4.apache.org,44777,1689837020621' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-20 07:10:32,430 DEBUG [member: 'jenkins-hbase4.apache.org,45099,1689837020733' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-20 07:10:32,430 DEBUG [member: 'jenkins-hbase4.apache.org,45099,1689837020733' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-07-20 07:10:32,428 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-07-20 07:10:32,430 DEBUG [member: 'jenkins-hbase4.apache.org,45099,1689837020733' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45099,1689837020733' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-07-20 07:10:32,430 DEBUG [member: 'jenkins-hbase4.apache.org,44955,1689837020792' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-20 07:10:32,430 DEBUG [member: 'jenkins-hbase4.apache.org,44777,1689837020621' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-07-20 07:10:32,430 DEBUG [member: 'jenkins-hbase4.apache.org,44955,1689837020792' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-20 07:10:32,430 DEBUG [member: 'jenkins-hbase4.apache.org,44777,1689837020621' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44777,1689837020621' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-07-20 07:10:32,432 DEBUG [member: 'jenkins-hbase4.apache.org,44955,1689837020792' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-20 07:10:32,432 DEBUG [member: 'jenkins-hbase4.apache.org,44955,1689837020792' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-07-20 07:10:32,432 DEBUG [member: 'jenkins-hbase4.apache.org,44955,1689837020792' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44955,1689837020792' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-07-20 07:10:32,434 DEBUG [member: 'jenkins-hbase4.apache.org,45099,1689837020733' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-20 07:10:32,436 DEBUG [member: 'jenkins-hbase4.apache.org,44777,1689837020621' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-20 07:10:32,436 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): master:37415-0x10181911f0f0000, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44777,1689837020621 2023-07-20 07:10:32,436 DEBUG [member: 'jenkins-hbase4.apache.org,45099,1689837020733' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45099-0x10181911f0f0002, quorum=127.0.0.1:58010, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-20 07:10:32,436 DEBUG [member: 'jenkins-hbase4.apache.org,45099,1689837020733' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-20 07:10:32,436 DEBUG [member: 'jenkins-hbase4.apache.org,44955,1689837020792' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-20 07:10:32,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44777,1689837020621 2023-07-20 07:10:32,436 DEBUG [member: 'jenkins-hbase4.apache.org,44777,1689837020621' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44777-0x10181911f0f0001, quorum=127.0.0.1:58010, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-20 07:10:32,436 DEBUG [member: 'jenkins-hbase4.apache.org,44777,1689837020621' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-20 07:10:32,436 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): master:37415-0x10181911f0f0000, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44955,1689837020792 2023-07-20 07:10:32,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-20 07:10:32,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-20 07:10:32,436 DEBUG [member: 'jenkins-hbase4.apache.org,44955,1689837020792' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44955-0x10181911f0f0003, quorum=127.0.0.1:58010, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-20 07:10:32,436 DEBUG [member: 'jenkins-hbase4.apache.org,44955,1689837020792' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-20 07:10:32,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-20 07:10:32,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-20 07:10:32,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-20 07:10:32,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44955,1689837020792 2023-07-20 07:10:32,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44777,1689837020621 2023-07-20 07:10:32,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45099,1689837020733 2023-07-20 07:10:32,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-20 07:10:32,439 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44777,1689837020621' joining acquired barrier for procedure 'snaptb0-testExportWithTargetName' on coordinator 2023-07-20 07:10:32,439 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@60a3f66b[Count = 1] remaining members to acquire global barrier 2023-07-20 07:10:32,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44955,1689837020792 2023-07-20 07:10:32,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-20 07:10:32,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-20 07:10:32,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-20 07:10:32,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-20 07:10:32,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-20 07:10:32,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44955,1689837020792 2023-07-20 07:10:32,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44777,1689837020621 2023-07-20 07:10:32,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45099,1689837020733 2023-07-20 07:10:32,442 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-20 07:10:32,442 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44955,1689837020792' joining acquired barrier for procedure 'snaptb0-testExportWithTargetName' on coordinator 2023-07-20 07:10:32,442 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@60a3f66b[Count = 0] remaining members to acquire global barrier 2023-07-20 07:10:32,442 DEBUG [(jenkins-hbase4.apache.org,37415,1689837019114)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportWithTargetName' starting 'in-barrier' execution. 2023-07-20 07:10:32,442 DEBUG [(jenkins-hbase4.apache.org,37415,1689837019114)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-20 07:10:32,447 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): regionserver:45099-0x10181911f0f0002, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-20 07:10:32,447 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): regionserver:44777-0x10181911f0f0001, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-20 07:10:32,447 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): regionserver:44955-0x10181911f0f0003, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-20 07:10:32,447 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-20 07:10:32,447 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-20 07:10:32,447 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-20 07:10:32,447 DEBUG [(jenkins-hbase4.apache.org,37415,1689837019114)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37415-0x10181911f0f0000, quorum=127.0.0.1:58010, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44777,1689837020621 2023-07-20 07:10:32,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-20 07:10:32,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-20 07:10:32,447 DEBUG [member: 'jenkins-hbase4.apache.org,44955,1689837020792' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-20 07:10:32,447 DEBUG [member: 'jenkins-hbase4.apache.org,44777,1689837020621' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-20 07:10:32,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-20 07:10:32,448 DEBUG [member: 'jenkins-hbase4.apache.org,45099,1689837020733' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-20 07:10:32,448 DEBUG [member: 'jenkins-hbase4.apache.org,45099,1689837020733' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-07-20 07:10:32,448 DEBUG [member: 'jenkins-hbase4.apache.org,44777,1689837020621' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-20 07:10:32,448 DEBUG [member: 'jenkins-hbase4.apache.org,44955,1689837020792' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-20 07:10:32,448 DEBUG [rs(jenkins-hbase4.apache.org,44777,1689837020621)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,,1689837030289.53766270354a2a06a7f98fc68a0a5641. 2023-07-20 07:10:32,448 DEBUG [member: 'jenkins-hbase4.apache.org,45099,1689837020733' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,45099,1689837020733' in zk 2023-07-20 07:10:32,448 DEBUG [(jenkins-hbase4.apache.org,37415,1689837019114)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37415-0x10181911f0f0000, quorum=127.0.0.1:58010, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44955,1689837020792 2023-07-20 07:10:32,448 DEBUG [(jenkins-hbase4.apache.org,37415,1689837019114)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-20 07:10:32,448 DEBUG [rs(jenkins-hbase4.apache.org,44777,1689837020621)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,,1689837030289.53766270354a2a06a7f98fc68a0a5641. started... 2023-07-20 07:10:32,448 DEBUG [rs(jenkins-hbase4.apache.org,44955,1689837020792)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,1,1689837030289.d13e9df15600884f95dc00d2b56a243b. 2023-07-20 07:10:32,448 DEBUG [member: 'jenkins-hbase4.apache.org,44955,1689837020792' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-20 07:10:32,448 DEBUG [rs(jenkins-hbase4.apache.org,44955,1689837020792)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,1,1689837030289.d13e9df15600884f95dc00d2b56a243b. started... 2023-07-20 07:10:32,448 DEBUG [member: 'jenkins-hbase4.apache.org,44777,1689837020621' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-20 07:10:32,448 INFO [rs(jenkins-hbase4.apache.org,44777,1689837020621)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 53766270354a2a06a7f98fc68a0a5641 1/1 column families, dataSize=132 B heapSize=544 B 2023-07-20 07:10:32,448 INFO [rs(jenkins-hbase4.apache.org,44955,1689837020792)-snapshot-pool-0] regionserver.HRegion(2745): Flushing d13e9df15600884f95dc00d2b56a243b 1/1 column families, dataSize=3.13 KB heapSize=7 KB 2023-07-20 07:10:32,451 DEBUG [member: 'jenkins-hbase4.apache.org,45099,1689837020733' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-07-20 07:10:32,451 DEBUG [member: 'jenkins-hbase4.apache.org,45099,1689837020733' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-20 07:10:32,451 DEBUG [member: 'jenkins-hbase4.apache.org,45099,1689837020733' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-07-20 07:10:32,495 DEBUG [Listener at jenkins-hbase4.apache.org/33837] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-20 07:10:32,497 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-20 07:10:32,497 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-20 07:10:32,497 DEBUG [Listener at jenkins-hbase4.apache.org/33837] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-20 07:10:32,674 INFO [rs(jenkins-hbase4.apache.org,44777,1689837020621)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023072095e0227624f64820b295f05aa26735f5 to hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e2023072095e0227624f64820b295f05aa26735f5 2023-07-20 07:10:32,675 INFO [rs(jenkins-hbase4.apache.org,44955,1689837020792)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230720356fde5cbbbc44e4a5ca519082102323 to hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b20230720356fde5cbbbc44e4a5ca519082102323 2023-07-20 07:10:32,698 DEBUG [Listener at jenkins-hbase4.apache.org/33837] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-20 07:10:32,701 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-20 07:10:32,712 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-20 07:10:32,713 DEBUG [Listener at jenkins-hbase4.apache.org/33837] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-20 07:10:32,730 INFO [rs(jenkins-hbase4.apache.org,44955,1689837020792)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/data/default/testtb-testExportWithTargetName/d13e9df15600884f95dc00d2b56a243b/.tmp/cf/1108370fd1be40979110ccc54c71b85d 2023-07-20 07:10:32,741 INFO [rs(jenkins-hbase4.apache.org,44777,1689837020621)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=132, hasBloomFilter=true, into tmp file hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/data/default/testtb-testExportWithTargetName/53766270354a2a06a7f98fc68a0a5641/.tmp/cf/43b75e8f9f6f4bc5ab342e08ca8b9d0e 2023-07-20 07:10:32,744 DEBUG [rs(jenkins-hbase4.apache.org,44955,1689837020792)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/data/default/testtb-testExportWithTargetName/d13e9df15600884f95dc00d2b56a243b/.tmp/cf/1108370fd1be40979110ccc54c71b85d as hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/data/default/testtb-testExportWithTargetName/d13e9df15600884f95dc00d2b56a243b/cf/1108370fd1be40979110ccc54c71b85d 2023-07-20 07:10:32,752 DEBUG [rs(jenkins-hbase4.apache.org,44777,1689837020621)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/data/default/testtb-testExportWithTargetName/53766270354a2a06a7f98fc68a0a5641/.tmp/cf/43b75e8f9f6f4bc5ab342e08ca8b9d0e as hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/data/default/testtb-testExportWithTargetName/53766270354a2a06a7f98fc68a0a5641/cf/43b75e8f9f6f4bc5ab342e08ca8b9d0e 2023-07-20 07:10:32,754 INFO [rs(jenkins-hbase4.apache.org,44955,1689837020792)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/data/default/testtb-testExportWithTargetName/d13e9df15600884f95dc00d2b56a243b/cf/1108370fd1be40979110ccc54c71b85d, entries=48, sequenceid=6, filesize=13.0 K 2023-07-20 07:10:32,758 INFO [rs(jenkins-hbase4.apache.org,44955,1689837020792)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.13 KB/3204, heapSize ~6.98 KB/7152, currentSize=0 B/0 for d13e9df15600884f95dc00d2b56a243b in 310ms, sequenceid=6, compaction requested=false 2023-07-20 07:10:32,759 DEBUG [rs(jenkins-hbase4.apache.org,44955,1689837020792)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportWithTargetName' 2023-07-20 07:10:32,759 DEBUG [rs(jenkins-hbase4.apache.org,44955,1689837020792)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for d13e9df15600884f95dc00d2b56a243b: 2023-07-20 07:10:32,760 DEBUG [rs(jenkins-hbase4.apache.org,44955,1689837020792)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,1,1689837030289.d13e9df15600884f95dc00d2b56a243b.' region-info for snapshot=snaptb0-testExportWithTargetName 2023-07-20 07:10:32,760 DEBUG [rs(jenkins-hbase4.apache.org,44955,1689837020792)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-20 07:10:32,760 DEBUG [rs(jenkins-hbase4.apache.org,44955,1689837020792)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/data/default/testtb-testExportWithTargetName/d13e9df15600884f95dc00d2b56a243b/cf/1108370fd1be40979110ccc54c71b85d] hfiles 2023-07-20 07:10:32,761 DEBUG [rs(jenkins-hbase4.apache.org,44955,1689837020792)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/data/default/testtb-testExportWithTargetName/d13e9df15600884f95dc00d2b56a243b/cf/1108370fd1be40979110ccc54c71b85d for snapshot=snaptb0-testExportWithTargetName 2023-07-20 07:10:32,763 INFO [rs(jenkins-hbase4.apache.org,44777,1689837020621)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/data/default/testtb-testExportWithTargetName/53766270354a2a06a7f98fc68a0a5641/cf/43b75e8f9f6f4bc5ab342e08ca8b9d0e, entries=2, sequenceid=6, filesize=5.2 K 2023-07-20 07:10:32,767 INFO [rs(jenkins-hbase4.apache.org,44777,1689837020621)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~132 B/132, heapSize ~528 B/528, currentSize=0 B/0 for 53766270354a2a06a7f98fc68a0a5641 in 319ms, sequenceid=6, compaction requested=false 2023-07-20 07:10:32,768 DEBUG [rs(jenkins-hbase4.apache.org,44777,1689837020621)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 53766270354a2a06a7f98fc68a0a5641: 2023-07-20 07:10:32,769 DEBUG [rs(jenkins-hbase4.apache.org,44777,1689837020621)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,,1689837030289.53766270354a2a06a7f98fc68a0a5641.' region-info for snapshot=snaptb0-testExportWithTargetName 2023-07-20 07:10:32,769 DEBUG [rs(jenkins-hbase4.apache.org,44777,1689837020621)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-20 07:10:32,769 DEBUG [rs(jenkins-hbase4.apache.org,44777,1689837020621)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/data/default/testtb-testExportWithTargetName/53766270354a2a06a7f98fc68a0a5641/cf/43b75e8f9f6f4bc5ab342e08ca8b9d0e] hfiles 2023-07-20 07:10:32,769 DEBUG [rs(jenkins-hbase4.apache.org,44777,1689837020621)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/data/default/testtb-testExportWithTargetName/53766270354a2a06a7f98fc68a0a5641/cf/43b75e8f9f6f4bc5ab342e08ca8b9d0e for snapshot=snaptb0-testExportWithTargetName 2023-07-20 07:10:32,809 DEBUG [rs(jenkins-hbase4.apache.org,44777,1689837020621)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,,1689837030289.53766270354a2a06a7f98fc68a0a5641. completed. 2023-07-20 07:10:32,809 DEBUG [rs(jenkins-hbase4.apache.org,44955,1689837020792)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,1,1689837030289.d13e9df15600884f95dc00d2b56a243b. completed. 2023-07-20 07:10:32,809 DEBUG [rs(jenkins-hbase4.apache.org,44777,1689837020621)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,,1689837030289.53766270354a2a06a7f98fc68a0a5641. 2023-07-20 07:10:32,809 DEBUG [rs(jenkins-hbase4.apache.org,44955,1689837020792)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,1,1689837030289.d13e9df15600884f95dc00d2b56a243b. 2023-07-20 07:10:32,809 DEBUG [member: 'jenkins-hbase4.apache.org,44777,1689837020621' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-20 07:10:32,809 DEBUG [member: 'jenkins-hbase4.apache.org,44777,1689837020621' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-20 07:10:32,809 DEBUG [member: 'jenkins-hbase4.apache.org,44955,1689837020792' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-20 07:10:32,810 DEBUG [member: 'jenkins-hbase4.apache.org,44955,1689837020792' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-20 07:10:32,810 DEBUG [member: 'jenkins-hbase4.apache.org,44955,1689837020792' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,44955,1689837020792 2023-07-20 07:10:32,809 DEBUG [member: 'jenkins-hbase4.apache.org,44777,1689837020621' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,44777,1689837020621 2023-07-20 07:10:32,810 DEBUG [member: 'jenkins-hbase4.apache.org,44955,1689837020792' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-07-20 07:10:32,810 DEBUG [member: 'jenkins-hbase4.apache.org,44777,1689837020621' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-07-20 07:10:32,810 DEBUG [member: 'jenkins-hbase4.apache.org,44955,1689837020792' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,44955,1689837020792' in zk 2023-07-20 07:10:32,810 DEBUG [member: 'jenkins-hbase4.apache.org,44777,1689837020621' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,44777,1689837020621' in zk 2023-07-20 07:10:32,812 DEBUG [member: 'jenkins-hbase4.apache.org,44777,1689837020621' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-07-20 07:10:32,812 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): master:37415-0x10181911f0f0000, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44777,1689837020621 2023-07-20 07:10:32,812 DEBUG [member: 'jenkins-hbase4.apache.org,44777,1689837020621' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-20 07:10:32,812 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44777,1689837020621 2023-07-20 07:10:32,812 DEBUG [member: 'jenkins-hbase4.apache.org,44777,1689837020621' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-07-20 07:10:32,813 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-20 07:10:32,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-20 07:10:32,814 DEBUG [member: 'jenkins-hbase4.apache.org,44955,1689837020792' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-07-20 07:10:32,814 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): master:37415-0x10181911f0f0000, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44955,1689837020792 2023-07-20 07:10:32,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-20 07:10:32,814 DEBUG [member: 'jenkins-hbase4.apache.org,44955,1689837020792' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-20 07:10:32,814 DEBUG [member: 'jenkins-hbase4.apache.org,44955,1689837020792' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-07-20 07:10:32,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-20 07:10:32,816 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-20 07:10:32,816 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44955,1689837020792 2023-07-20 07:10:32,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44777,1689837020621 2023-07-20 07:10:32,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45099,1689837020733 2023-07-20 07:10:32,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-20 07:10:32,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-20 07:10:32,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44955,1689837020792 2023-07-20 07:10:32,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44777,1689837020621 2023-07-20 07:10:32,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45099,1689837020733 2023-07-20 07:10:32,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,44777,1689837020621': 2023-07-20 07:10:32,820 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44777,1689837020621' released barrier for procedure'snaptb0-testExportWithTargetName', counting down latch. Waiting for 1 more 2023-07-20 07:10:32,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44955,1689837020792 2023-07-20 07:10:32,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-20 07:10:32,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-20 07:10:32,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-20 07:10:32,821 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-20 07:10:32,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-20 07:10:32,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44955,1689837020792 2023-07-20 07:10:32,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44777,1689837020621 2023-07-20 07:10:32,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45099,1689837020733 2023-07-20 07:10:32,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-20 07:10:32,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-20 07:10:32,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44955,1689837020792 2023-07-20 07:10:32,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44777,1689837020621 2023-07-20 07:10:32,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45099,1689837020733 2023-07-20 07:10:32,826 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,44955,1689837020792': 2023-07-20 07:10:32,826 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44955,1689837020792' released barrier for procedure'snaptb0-testExportWithTargetName', counting down latch. Waiting for 0 more 2023-07-20 07:10:32,826 INFO [(jenkins-hbase4.apache.org,37415,1689837019114)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportWithTargetName' execution completed 2023-07-20 07:10:32,826 DEBUG [(jenkins-hbase4.apache.org,37415,1689837019114)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-20 07:10:32,826 DEBUG [(jenkins-hbase4.apache.org,37415,1689837019114)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-20 07:10:32,826 DEBUG [(jenkins-hbase4.apache.org,37415,1689837019114)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportWithTargetName 2023-07-20 07:10:32,826 INFO [(jenkins-hbase4.apache.org,37415,1689837019114)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportWithTargetNameincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-20 07:10:32,828 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): master:37415-0x10181911f0f0000, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-20 07:10:32,828 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): regionserver:44777-0x10181911f0f0001, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-20 07:10:32,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-20 07:10:32,828 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-20 07:10:32,828 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): regionserver:45099-0x10181911f0f0002, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-20 07:10:32,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-20 07:10:32,828 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): regionserver:44955-0x10181911f0f0003, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-20 07:10:32,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-20 07:10:32,829 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-20 07:10:32,829 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-20 07:10:32,828 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): regionserver:44777-0x10181911f0f0001, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 07:10:32,829 DEBUG [(jenkins-hbase4.apache.org,37415,1689837019114)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37415-0x10181911f0f0000, quorum=127.0.0.1:58010, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44955,1689837020792 2023-07-20 07:10:32,829 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-20 07:10:32,829 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): regionserver:44955-0x10181911f0f0003, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 07:10:32,829 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-20 07:10:32,829 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 07:10:32,829 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 07:10:32,828 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): regionserver:45099-0x10181911f0f0002, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 07:10:32,829 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 07:10:32,829 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 07:10:32,829 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-20 07:10:32,830 DEBUG [(jenkins-hbase4.apache.org,37415,1689837019114)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37415-0x10181911f0f0000, quorum=127.0.0.1:58010, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44777,1689837020621 2023-07-20 07:10:32,830 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-20 07:10:32,830 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-20 07:10:32,830 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-20 07:10:32,830 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 07:10:32,830 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 07:10:32,830 DEBUG [(jenkins-hbase4.apache.org,37415,1689837019114)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37415-0x10181911f0f0000, quorum=127.0.0.1:58010, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45099,1689837020733 2023-07-20 07:10:32,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-20 07:10:32,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-20 07:10:32,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-20 07:10:32,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-20 07:10:32,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44955,1689837020792 2023-07-20 07:10:32,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44777,1689837020621 2023-07-20 07:10:32,832 DEBUG [(jenkins-hbase4.apache.org,37415,1689837019114)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37415-0x10181911f0f0000, quorum=127.0.0.1:58010, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44955,1689837020792 2023-07-20 07:10:32,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45099,1689837020733 2023-07-20 07:10:32,833 DEBUG [(jenkins-hbase4.apache.org,37415,1689837019114)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37415-0x10181911f0f0000, quorum=127.0.0.1:58010, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44777,1689837020621 2023-07-20 07:10:32,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-20 07:10:32,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-20 07:10:32,833 DEBUG [(jenkins-hbase4.apache.org,37415,1689837019114)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37415-0x10181911f0f0000, quorum=127.0.0.1:58010, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45099,1689837020733 2023-07-20 07:10:32,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44955,1689837020792 2023-07-20 07:10:32,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44777,1689837020621 2023-07-20 07:10:32,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45099,1689837020733 2023-07-20 07:10:32,848 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): regionserver:45099-0x10181911f0f0002, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 07:10:32,849 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): regionserver:44777-0x10181911f0f0001, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 07:10:32,849 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 07:10:32,849 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 07:10:32,849 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): regionserver:45099-0x10181911f0f0002, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 07:10:32,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 07:10:32,849 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportWithTargetName 2023-07-20 07:10:32,849 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): master:37415-0x10181911f0f0000, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45099,1689837020733 2023-07-20 07:10:32,849 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportWithTargetName 2023-07-20 07:10:32,849 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): regionserver:44777-0x10181911f0f0001, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 07:10:32,849 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): master:37415-0x10181911f0f0000, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-20 07:10:32,849 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 90c8eeaaf01a24f585da11044309be71, NAME => 'testtb-testExportWithTargetName,.mob,0.90c8eeaaf01a24f585da11044309be71.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportWithTargetName 2023-07-20 07:10:32,849 DEBUG [(jenkins-hbase4.apache.org,37415,1689837019114)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-20 07:10:32,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 07:10:32,849 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-20 07:10:32,850 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 07:10:32,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 07:10:32,850 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): regionserver:44955-0x10181911f0f0003, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 07:10:32,850 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): regionserver:44955-0x10181911f0f0003, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 07:10:32,849 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): master:37415-0x10181911f0f0000, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44777,1689837020621 2023-07-20 07:10:32,850 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 07:10:32,850 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 07:10:32,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 07:10:32,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 07:10:32,850 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): master:37415-0x10181911f0f0000, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44955,1689837020792 2023-07-20 07:10:32,851 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): master:37415-0x10181911f0f0000, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-20 07:10:32,851 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): master:37415-0x10181911f0f0000, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45099,1689837020733 2023-07-20 07:10:32,851 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): master:37415-0x10181911f0f0000, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-20 07:10:32,851 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): master:37415-0x10181911f0f0000, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44777,1689837020621 2023-07-20 07:10:32,851 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): master:37415-0x10181911f0f0000, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44955,1689837020792 2023-07-20 07:10:32,851 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): master:37415-0x10181911f0f0000, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-20 07:10:32,851 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): master:37415-0x10181911f0f0000, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-20 07:10:32,851 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 07:10:32,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 07:10:32,851 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b20230720356fde5cbbbc44e4a5ca519082102323, hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e2023072095e0227624f64820b295f05aa26735f5] mob files 2023-07-20 07:10:32,851 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b20230720356fde5cbbbc44e4a5ca519082102323 2023-07-20 07:10:32,851 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e2023072095e0227624f64820b295f05aa26735f5 2023-07-20 07:10:32,881 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportWithTargetName 2023-07-20 07:10:32,882 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-07-20 07:10:32,925 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName to hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/.hbase-snapshot/snaptb0-testExportWithTargetName 2023-07-20 07:10:32,960 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed 2023-07-20 07:10:32,960 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-07-20 07:10:32,961 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-07-20 07:10:32,961 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName at 1689837032394Completed referencing HFiles for the mob region of table: testtb-testExportWithTargetName at 1689837032881 (+487 ms)Consolidate snapshot: snaptb0-testExportWithTargetName at 1689837032881Loading Region manifests for snaptb0-testExportWithTargetName at 1689837032881Writing data manifest for snaptb0-testExportWithTargetName at 1689837032890 (+9 ms)Verifying snapshot: snaptb0-testExportWithTargetName at 1689837032913 (+23 ms)Snapshot snaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed at 1689837032960 (+47 ms) 2023-07-20 07:10:32,963 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=20, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-20 07:10:32,966 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=20, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED in 568 msec 2023-07-20 07:10:33,013 DEBUG [Listener at jenkins-hbase4.apache.org/33837] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-20 07:10:33,016 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-20 07:10:33,016 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-20 07:10:33,017 INFO [Listener at jenkins-hbase4.apache.org/33837] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/export-test/export-1689837033017 2023-07-20 07:10:33,018 INFO [Listener at jenkins-hbase4.apache.org/33837] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:39649, tgtDir=hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/export-test/export-1689837033017, rawTgtDir=hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/export-test/export-1689837033017, srcFsUri=hdfs://localhost:39649, srcDir=hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b 2023-07-20 07:10:33,076 DEBUG [Listener at jenkins-hbase4.apache.org/33837] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:39649, inputRoot=hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b 2023-07-20 07:10:33,076 DEBUG [Listener at jenkins-hbase4.apache.org/33837] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1583484851_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/export-test/export-1689837033017, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/export-test/export-1689837033017/.hbase-snapshot/.tmp/testExportWithTargetName 2023-07-20 07:10:33,077 INFO [Listener at jenkins-hbase4.apache.org/33837] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:39649, inputRoot=hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b, snapshotDir=hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/.hbase-snapshot/snaptb0-testExportWithTargetName. 2023-07-20 07:10:33,122 INFO [Listener at jenkins-hbase4.apache.org/33837] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/.hbase-snapshot/snaptb0-testExportWithTargetName to hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/export-test/export-1689837033017/.hbase-snapshot/.tmp/testExportWithTargetName 2023-07-20 07:10:33,639 DEBUG [Listener at jenkins-hbase4.apache.org/33837] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-20 07:10:33,640 DEBUG [Listener at jenkins-hbase4.apache.org/33837] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-20 07:10:33,640 DEBUG [Listener at jenkins-hbase4.apache.org/33837] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-20 07:10:33,641 DEBUG [Listener at jenkins-hbase4.apache.org/33837] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-20 07:10:33,641 DEBUG [Listener at jenkins-hbase4.apache.org/33837] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-20 07:10:33,641 DEBUG [Listener at jenkins-hbase4.apache.org/33837] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-20 07:10:33,642 DEBUG [Listener at jenkins-hbase4.apache.org/33837] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-20 07:10:33,744 DEBUG [Listener at jenkins-hbase4.apache.org/33837] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c07d5e8c-eba2-0ae8-aa3a-b7afa648e7e7/hadoop-1691071083627329479.jar 2023-07-20 07:10:33,745 DEBUG [Listener at jenkins-hbase4.apache.org/33837] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-20 07:10:33,745 DEBUG [Listener at jenkins-hbase4.apache.org/33837] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-20 07:10:33,746 DEBUG [Listener at jenkins-hbase4.apache.org/33837] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-20 07:10:33,747 DEBUG [Listener at jenkins-hbase4.apache.org/33837] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-20 07:10:33,748 DEBUG [Listener at jenkins-hbase4.apache.org/33837] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-20 07:10:33,758 DEBUG [Listener at jenkins-hbase4.apache.org/33837] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-20 07:10:33,759 DEBUG [Listener at jenkins-hbase4.apache.org/33837] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-20 07:10:33,760 DEBUG [Listener at jenkins-hbase4.apache.org/33837] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-20 07:10:33,771 DEBUG [Listener at jenkins-hbase4.apache.org/33837] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-20 07:10:33,772 DEBUG [Listener at jenkins-hbase4.apache.org/33837] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-20 07:10:33,772 DEBUG [Listener at jenkins-hbase4.apache.org/33837] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-20 07:10:33,773 DEBUG [Listener at jenkins-hbase4.apache.org/33837] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-20 07:10:33,773 DEBUG [Listener at jenkins-hbase4.apache.org/33837] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-20 07:10:33,774 DEBUG [Listener at jenkins-hbase4.apache.org/33837] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-20 07:10:33,775 DEBUG [Listener at jenkins-hbase4.apache.org/33837] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-20 07:10:33,775 DEBUG [Listener at jenkins-hbase4.apache.org/33837] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-20 07:10:33,780 DEBUG [Listener at jenkins-hbase4.apache.org/33837] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-20 07:10:33,780 DEBUG [Listener at jenkins-hbase4.apache.org/33837] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-20 07:10:33,781 DEBUG [Listener at jenkins-hbase4.apache.org/33837] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-20 07:10:33,781 DEBUG [Listener at jenkins-hbase4.apache.org/33837] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-20 07:10:33,781 DEBUG [Listener at jenkins-hbase4.apache.org/33837] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-20 07:10:33,782 DEBUG [Listener at jenkins-hbase4.apache.org/33837] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-20 07:10:33,782 DEBUG [Listener at jenkins-hbase4.apache.org/33837] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-20 07:10:34,719 WARN [Listener at jenkins-hbase4.apache.org/33837] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-20 07:10:34,726 INFO [Listener at jenkins-hbase4.apache.org/33837] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportWithTargetName' hfile list 2023-07-20 07:10:34,736 DEBUG [Listener at jenkins-hbase4.apache.org/33837] snapshot.ExportSnapshot(671): export split=0 size=30.9 K 2023-07-20 07:10:35,354 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-20 07:10:35,356 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-20 07:10:35,955 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689837028633_0001_000001 (auth:SIMPLE) 2023-07-20 07:10:36,296 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-20 07:10:41,725 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689837028633_0001_000001 (auth:SIMPLE) 2023-07-20 07:10:44,016 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689837028633_0001_000001 (auth:SIMPLE) 2023-07-20 07:10:47,510 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689837028633_0001_000001 (auth:SIMPLE) 2023-07-20 07:10:48,755 INFO [Listener at jenkins-hbase4.apache.org/33837] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-20 07:10:48,758 INFO [Listener at jenkins-hbase4.apache.org/33837] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-20 07:10:48,773 INFO [Listener at jenkins-hbase4.apache.org/33837] snapshot.ExportSnapshot(1127): Export Completed: testExportWithTargetName 2023-07-20 07:10:48,773 INFO [Listener at jenkins-hbase4.apache.org/33837] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-20 07:10:48,774 INFO [Listener at jenkins-hbase4.apache.org/33837] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-20 07:10:48,774 DEBUG [Listener at jenkins-hbase4.apache.org/33837] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_759529442_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/.hbase-snapshot/snaptb0-testExportWithTargetName at hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/.hbase-snapshot/snaptb0-testExportWithTargetName 2023-07-20 07:10:48,775 DEBUG [Listener at jenkins-hbase4.apache.org/33837] snapshot.TestExportSnapshot(367): hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/.hbase-snapshot/snaptb0-testExportWithTargetName/.snapshotinfo 2023-07-20 07:10:48,775 DEBUG [Listener at jenkins-hbase4.apache.org/33837] snapshot.TestExportSnapshot(367): hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/.hbase-snapshot/snaptb0-testExportWithTargetName/data.manifest 2023-07-20 07:10:48,775 DEBUG [Listener at jenkins-hbase4.apache.org/33837] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_759529442_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/export-test/export-1689837033017/.hbase-snapshot/testExportWithTargetName at hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/export-test/export-1689837033017/.hbase-snapshot/testExportWithTargetName 2023-07-20 07:10:48,775 DEBUG [Listener at jenkins-hbase4.apache.org/33837] snapshot.TestExportSnapshot(367): hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/export-test/export-1689837033017/.hbase-snapshot/testExportWithTargetName/.snapshotinfo 2023-07-20 07:10:48,775 DEBUG [Listener at jenkins-hbase4.apache.org/33837] snapshot.TestExportSnapshot(367): hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/export-test/export-1689837033017/.hbase-snapshot/testExportWithTargetName/data.manifest 2023-07-20 07:10:48,787 INFO [Listener at jenkins-hbase4.apache.org/33837] client.HBaseAdmin$15(890): Started disable of testtb-testExportWithTargetName 2023-07-20 07:10:48,792 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportWithTargetName 2023-07-20 07:10:48,801 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] procedure2.ProcedureExecutor(1029): Stored pid=21, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportWithTargetName 2023-07-20 07:10:48,807 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689837048807"}]},"ts":"1689837048807"} 2023-07-20 07:10:48,808 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-07-20 07:10:48,809 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=DISABLING in hbase:meta 2023-07-20 07:10:48,811 INFO [PEWorker-4] procedure.DisableTableProcedure(293): Set testtb-testExportWithTargetName to state=DISABLING 2023-07-20 07:10:48,813 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=22, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=53766270354a2a06a7f98fc68a0a5641, UNASSIGN}, {pid=23, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=d13e9df15600884f95dc00d2b56a243b, UNASSIGN}] 2023-07-20 07:10:48,816 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=22, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=53766270354a2a06a7f98fc68a0a5641, UNASSIGN 2023-07-20 07:10:48,816 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=23, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=d13e9df15600884f95dc00d2b56a243b, UNASSIGN 2023-07-20 07:10:48,817 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=23 updating hbase:meta row=d13e9df15600884f95dc00d2b56a243b, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,44955,1689837020792 2023-07-20 07:10:48,817 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=22 updating hbase:meta row=53766270354a2a06a7f98fc68a0a5641, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,44777,1689837020621 2023-07-20 07:10:48,817 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,,1689837030289.53766270354a2a06a7f98fc68a0a5641.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689837048817"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689837048817"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689837048817"}]},"ts":"1689837048817"} 2023-07-20 07:10:48,817 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,1,1689837030289.d13e9df15600884f95dc00d2b56a243b.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689837048817"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689837048817"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689837048817"}]},"ts":"1689837048817"} 2023-07-20 07:10:48,820 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=24, ppid=23, state=RUNNABLE; CloseRegionProcedure d13e9df15600884f95dc00d2b56a243b, server=jenkins-hbase4.apache.org,44955,1689837020792}] 2023-07-20 07:10:48,820 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=25, ppid=22, state=RUNNABLE; CloseRegionProcedure 53766270354a2a06a7f98fc68a0a5641, server=jenkins-hbase4.apache.org,44777,1689837020621}] 2023-07-20 07:10:48,909 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-07-20 07:10:48,982 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 53766270354a2a06a7f98fc68a0a5641 2023-07-20 07:10:48,982 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close d13e9df15600884f95dc00d2b56a243b 2023-07-20 07:10:48,982 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 53766270354a2a06a7f98fc68a0a5641, disabling compactions & flushes 2023-07-20 07:10:48,982 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing d13e9df15600884f95dc00d2b56a243b, disabling compactions & flushes 2023-07-20 07:10:48,982 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,,1689837030289.53766270354a2a06a7f98fc68a0a5641. 2023-07-20 07:10:48,982 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,1,1689837030289.d13e9df15600884f95dc00d2b56a243b. 2023-07-20 07:10:48,982 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,,1689837030289.53766270354a2a06a7f98fc68a0a5641. 2023-07-20 07:10:48,982 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,1,1689837030289.d13e9df15600884f95dc00d2b56a243b. 2023-07-20 07:10:48,982 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,,1689837030289.53766270354a2a06a7f98fc68a0a5641. after waiting 0 ms 2023-07-20 07:10:48,982 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,1,1689837030289.d13e9df15600884f95dc00d2b56a243b. after waiting 0 ms 2023-07-20 07:10:48,982 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,1,1689837030289.d13e9df15600884f95dc00d2b56a243b. 2023-07-20 07:10:48,982 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,,1689837030289.53766270354a2a06a7f98fc68a0a5641. 2023-07-20 07:10:48,997 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/data/default/testtb-testExportWithTargetName/d13e9df15600884f95dc00d2b56a243b/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-20 07:10:48,997 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/data/default/testtb-testExportWithTargetName/53766270354a2a06a7f98fc68a0a5641/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-20 07:10:48,998 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-20 07:10:48,998 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-20 07:10:48,999 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,1,1689837030289.d13e9df15600884f95dc00d2b56a243b. 2023-07-20 07:10:49,000 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,,1689837030289.53766270354a2a06a7f98fc68a0a5641. 2023-07-20 07:10:49,000 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for d13e9df15600884f95dc00d2b56a243b: 2023-07-20 07:10:49,000 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 53766270354a2a06a7f98fc68a0a5641: 2023-07-20 07:10:49,003 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed d13e9df15600884f95dc00d2b56a243b 2023-07-20 07:10:49,004 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=23 updating hbase:meta row=d13e9df15600884f95dc00d2b56a243b, regionState=CLOSED 2023-07-20 07:10:49,004 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,1,1689837030289.d13e9df15600884f95dc00d2b56a243b.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689837049004"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689837049004"}]},"ts":"1689837049004"} 2023-07-20 07:10:49,004 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 53766270354a2a06a7f98fc68a0a5641 2023-07-20 07:10:49,005 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=22 updating hbase:meta row=53766270354a2a06a7f98fc68a0a5641, regionState=CLOSED 2023-07-20 07:10:49,005 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,,1689837030289.53766270354a2a06a7f98fc68a0a5641.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689837049005"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689837049005"}]},"ts":"1689837049005"} 2023-07-20 07:10:49,009 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=24, resume processing ppid=23 2023-07-20 07:10:49,009 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=24, ppid=23, state=SUCCESS; CloseRegionProcedure d13e9df15600884f95dc00d2b56a243b, server=jenkins-hbase4.apache.org,44955,1689837020792 in 186 msec 2023-07-20 07:10:49,010 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=25, resume processing ppid=22 2023-07-20 07:10:49,010 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=25, ppid=22, state=SUCCESS; CloseRegionProcedure 53766270354a2a06a7f98fc68a0a5641, server=jenkins-hbase4.apache.org,44777,1689837020621 in 187 msec 2023-07-20 07:10:49,011 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=23, ppid=21, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=d13e9df15600884f95dc00d2b56a243b, UNASSIGN in 196 msec 2023-07-20 07:10:49,012 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=22, resume processing ppid=21 2023-07-20 07:10:49,012 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=22, ppid=21, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=53766270354a2a06a7f98fc68a0a5641, UNASSIGN in 197 msec 2023-07-20 07:10:49,013 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689837049013"}]},"ts":"1689837049013"} 2023-07-20 07:10:49,015 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=DISABLED in hbase:meta 2023-07-20 07:10:49,017 INFO [PEWorker-4] procedure.DisableTableProcedure(305): Set testtb-testExportWithTargetName to state=DISABLED 2023-07-20 07:10:49,019 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=21, state=SUCCESS; DisableTableProcedure table=testtb-testExportWithTargetName in 222 msec 2023-07-20 07:10:49,111 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-07-20 07:10:49,111 INFO [Listener at jenkins-hbase4.apache.org/33837] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportWithTargetName, procId: 21 completed 2023-07-20 07:10:49,117 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportWithTargetName 2023-07-20 07:10:49,124 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] procedure2.ProcedureExecutor(1029): Stored pid=26, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-20 07:10:49,127 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=26, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-20 07:10:49,128 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportWithTargetName 2023-07-20 07:10:49,129 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=26, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-20 07:10:49,133 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=44955] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportWithTargetName 2023-07-20 07:10:49,135 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/.tmp/data/default/testtb-testExportWithTargetName/53766270354a2a06a7f98fc68a0a5641 2023-07-20 07:10:49,135 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/.tmp/data/default/testtb-testExportWithTargetName/d13e9df15600884f95dc00d2b56a243b 2023-07-20 07:10:49,136 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): regionserver:45099-0x10181911f0f0002, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-20 07:10:49,136 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): regionserver:44955-0x10181911f0f0003, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-20 07:10:49,136 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): regionserver:44777-0x10181911f0f0001, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-20 07:10:49,136 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): master:37415-0x10181911f0f0000, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-20 07:10:49,138 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): master:37415-0x10181911f0f0000, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-20 07:10:49,138 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): regionserver:44955-0x10181911f0f0003, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-20 07:10:49,138 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data null 2023-07-20 07:10:49,138 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data null 2023-07-20 07:10:49,138 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): regionserver:44777-0x10181911f0f0001, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-20 07:10:49,138 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): regionserver:45099-0x10181911f0f0002, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-20 07:10:49,138 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-20 07:10:49,138 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-20 07:10:49,138 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data null 2023-07-20 07:10:49,138 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data null 2023-07-20 07:10:49,139 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-20 07:10:49,139 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-20 07:10:49,140 DEBUG [HFileArchiver-6] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/.tmp/data/default/testtb-testExportWithTargetName/d13e9df15600884f95dc00d2b56a243b/cf, FileablePath, hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/.tmp/data/default/testtb-testExportWithTargetName/d13e9df15600884f95dc00d2b56a243b/recovered.edits] 2023-07-20 07:10:49,140 DEBUG [HFileArchiver-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/.tmp/data/default/testtb-testExportWithTargetName/53766270354a2a06a7f98fc68a0a5641/cf, FileablePath, hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/.tmp/data/default/testtb-testExportWithTargetName/53766270354a2a06a7f98fc68a0a5641/recovered.edits] 2023-07-20 07:10:49,141 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] master.MasterRpcServices(1230): Checking to see if procedure is done pid=26 2023-07-20 07:10:49,147 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/.tmp/data/default/testtb-testExportWithTargetName/d13e9df15600884f95dc00d2b56a243b/cf/1108370fd1be40979110ccc54c71b85d to hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/archive/data/default/testtb-testExportWithTargetName/d13e9df15600884f95dc00d2b56a243b/cf/1108370fd1be40979110ccc54c71b85d 2023-07-20 07:10:49,148 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/.tmp/data/default/testtb-testExportWithTargetName/53766270354a2a06a7f98fc68a0a5641/cf/43b75e8f9f6f4bc5ab342e08ca8b9d0e to hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/archive/data/default/testtb-testExportWithTargetName/53766270354a2a06a7f98fc68a0a5641/cf/43b75e8f9f6f4bc5ab342e08ca8b9d0e 2023-07-20 07:10:49,152 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/.tmp/data/default/testtb-testExportWithTargetName/d13e9df15600884f95dc00d2b56a243b/recovered.edits/9.seqid to hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/archive/data/default/testtb-testExportWithTargetName/d13e9df15600884f95dc00d2b56a243b/recovered.edits/9.seqid 2023-07-20 07:10:49,152 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/.tmp/data/default/testtb-testExportWithTargetName/53766270354a2a06a7f98fc68a0a5641/recovered.edits/9.seqid to hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/archive/data/default/testtb-testExportWithTargetName/53766270354a2a06a7f98fc68a0a5641/recovered.edits/9.seqid 2023-07-20 07:10:49,153 DEBUG [HFileArchiver-6] backup.HFileArchiver(596): Deleted hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/.tmp/data/default/testtb-testExportWithTargetName/d13e9df15600884f95dc00d2b56a243b 2023-07-20 07:10:49,153 DEBUG [HFileArchiver-5] backup.HFileArchiver(596): Deleted hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/.tmp/data/default/testtb-testExportWithTargetName/53766270354a2a06a7f98fc68a0a5641 2023-07-20 07:10:49,153 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testExportWithTargetName regions 2023-07-20 07:10:49,154 DEBUG [PEWorker-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71 2023-07-20 07:10:49,154 DEBUG [PEWorker-1] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf] 2023-07-20 07:10:49,158 DEBUG [PEWorker-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b20230720356fde5cbbbc44e4a5ca519082102323 to hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/archive/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b20230720356fde5cbbbc44e4a5ca519082102323 2023-07-20 07:10:49,160 DEBUG [PEWorker-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e2023072095e0227624f64820b295f05aa26735f5 to hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/archive/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e2023072095e0227624f64820b295f05aa26735f5 2023-07-20 07:10:49,160 DEBUG [PEWorker-1] backup.HFileArchiver(596): Deleted hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71 2023-07-20 07:10:49,163 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=26, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-20 07:10:49,185 WARN [PEWorker-1] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportWithTargetName from hbase:meta 2023-07-20 07:10:49,188 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportWithTargetName' descriptor. 2023-07-20 07:10:49,190 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=26, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-20 07:10:49,190 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportWithTargetName' from region states. 2023-07-20 07:10:49,190 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName,,1689837030289.53766270354a2a06a7f98fc68a0a5641.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689837049190"}]},"ts":"9223372036854775807"} 2023-07-20 07:10:49,190 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName,1,1689837030289.d13e9df15600884f95dc00d2b56a243b.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689837049190"}]},"ts":"9223372036854775807"} 2023-07-20 07:10:49,193 INFO [PEWorker-1] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-20 07:10:49,193 DEBUG [PEWorker-1] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 53766270354a2a06a7f98fc68a0a5641, NAME => 'testtb-testExportWithTargetName,,1689837030289.53766270354a2a06a7f98fc68a0a5641.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => d13e9df15600884f95dc00d2b56a243b, NAME => 'testtb-testExportWithTargetName,1,1689837030289.d13e9df15600884f95dc00d2b56a243b.', STARTKEY => '1', ENDKEY => ''}] 2023-07-20 07:10:49,193 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportWithTargetName' as deleted. 2023-07-20 07:10:49,193 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689837049193"}]},"ts":"9223372036854775807"} 2023-07-20 07:10:49,201 INFO [PEWorker-1] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportWithTargetName state from META 2023-07-20 07:10:49,204 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(130): Finished pid=26, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-20 07:10:49,206 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=26, state=SUCCESS; DeleteTableProcedure table=testtb-testExportWithTargetName in 86 msec 2023-07-20 07:10:49,243 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] master.MasterRpcServices(1230): Checking to see if procedure is done pid=26 2023-07-20 07:10:49,245 INFO [Listener at jenkins-hbase4.apache.org/33837] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportWithTargetName, procId: 26 completed 2023-07-20 07:10:49,267 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportWithTargetName" 2023-07-20 07:10:49,271 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportWithTargetName 2023-07-20 07:10:49,278 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportWithTargetName" 2023-07-20 07:10:49,281 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportWithTargetName 2023-07-20 07:10:49,327 INFO [Listener at jenkins-hbase4.apache.org/33837] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportWithTargetName Thread=753 (was 706) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c07d5e8c-eba2-0ae8-aa3a-b7afa648e7e7/cluster_fb56fef8-ff82-388f-e012-71bf1b21f2d0/dfs/data/data4/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c07d5e8c-eba2-0ae8-aa3a-b7afa648e7e7/cluster_fb56fef8-ff82-388f-e012-71bf1b21f2d0/dfs/data/data2/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-3-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (309353702) connection to jenkins-hbase4.apache.org/172.31.14.131:39329 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,44955,1689837020792' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,44777,1689837020621' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c07d5e8c-eba2-0ae8-aa3a-b7afa648e7e7/cluster_fb56fef8-ff82-388f-e012-71bf1b21f2d0/dfs/data/data6/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-1316 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: hconnection-0x7a39bf3a-shared-pool-11 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ContainersLauncher #0 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.read1(BufferedReader.java:212) java.io.BufferedReader.read(BufferedReader.java:286) org.apache.hadoop.util.Shell$ShellCommandExecutor.parseExecResult(Shell.java:1229) org.apache.hadoop.util.Shell.runCommand(Shell.java:984) org.apache.hadoop.util.Shell.run(Shell.java:884) org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:1216) org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.launchContainer(DefaultContainerExecutor.java:294) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.launchContainer(ContainerLaunch.java:442) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:293) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:97) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-2 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Container metrics unregistration java.lang.Object.wait(Native Method) java.util.TimerThread.mainLoop(Timer.java:552) java.util.TimerThread.run(Timer.java:505) Potentially hanging thread: HFileArchiver-4 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MutableQuantiles-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-3-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x7a39bf3a-shared-pool-12 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c07d5e8c-eba2-0ae8-aa3a-b7afa648e7e7/cluster_fb56fef8-ff82-388f-e012-71bf1b21f2d0/dfs/data/data1/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1723042852_1 at /127.0.0.1:38604 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c07d5e8c-eba2-0ae8-aa3a-b7afa648e7e7/cluster_fb56fef8-ff82-388f-e012-71bf1b21f2d0/dfs/data/data5/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x7a39bf3a-shared-pool-10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: htable-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x7a39bf3a-shared-pool-9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ContainersLauncher #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-5 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: htable-pool-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-6 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_759529442_17 at /127.0.0.1:45774 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-3 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c07d5e8c-eba2-0ae8-aa3a-b7afa648e7e7/cluster_fb56fef8-ff82-388f-e012-71bf1b21f2d0/dfs/data/data3/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,45099,1689837020733' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (309353702) connection to jenkins-hbase4.apache.org/172.31.14.131:41595 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_759529442_17 at /127.0.0.1:49452 [Waiting for operation #6] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-4 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: (jenkins-hbase4.apache.org,37415,1689837019114)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1723042852_1 at /127.0.0.1:45768 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=922 (was 902) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=381 (was 273) - SystemLoadAverage LEAK? -, ProcessCount=183 (was 176) - ProcessCount LEAK? -, AvailableMemoryMB=2852 (was 4540) 2023-07-20 07:10:49,328 WARN [Listener at jenkins-hbase4.apache.org/33837] hbase.ResourceChecker(130): Thread=753 is superior to 500 2023-07-20 07:10:49,356 INFO [Listener at jenkins-hbase4.apache.org/33837] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportFileSystemState Thread=753, OpenFileDescriptor=922, MaxFileDescriptor=60000, SystemLoadAverage=381, ProcessCount=183, AvailableMemoryMB=2851 2023-07-20 07:10:49,356 WARN [Listener at jenkins-hbase4.apache.org/33837] hbase.ResourceChecker(130): Thread=753 is superior to 500 2023-07-20 07:10:49,359 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-07-20 07:10:49,363 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] procedure2.ProcedureExecutor(1029): Stored pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemState 2023-07-20 07:10:49,366 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_PRE_OPERATION 2023-07-20 07:10:49,368 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemState" procId is: 27 2023-07-20 07:10:49,369 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-20 07:10:49,369 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-20 07:10:49,372 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/.tmp/data/default/testtb-testExportFileSystemState/21bd4c362a1ad0a15a803722233575a3 2023-07-20 07:10:49,372 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/.tmp/data/default/testtb-testExportFileSystemState/151c29dd29443231c3428e1d11842a2b 2023-07-20 07:10:49,373 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/.tmp/data/default/testtb-testExportFileSystemState/151c29dd29443231c3428e1d11842a2b empty. 2023-07-20 07:10:49,373 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/.tmp/data/default/testtb-testExportFileSystemState/21bd4c362a1ad0a15a803722233575a3 empty. 2023-07-20 07:10:49,373 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/.tmp/data/default/testtb-testExportFileSystemState/151c29dd29443231c3428e1d11842a2b 2023-07-20 07:10:49,373 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/.tmp/data/default/testtb-testExportFileSystemState/21bd4c362a1ad0a15a803722233575a3 2023-07-20 07:10:49,373 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemState regions 2023-07-20 07:10:49,471 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-20 07:10:49,672 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-20 07:10:49,796 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/.tmp/data/default/testtb-testExportFileSystemState/.tabledesc/.tableinfo.0000000001 2023-07-20 07:10:49,798 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(7675): creating {ENCODED => 151c29dd29443231c3428e1d11842a2b, NAME => 'testtb-testExportFileSystemState,1,1689837049358.151c29dd29443231c3428e1d11842a2b.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/.tmp 2023-07-20 07:10:49,798 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(7675): creating {ENCODED => 21bd4c362a1ad0a15a803722233575a3, NAME => 'testtb-testExportFileSystemState,,1689837049358.21bd4c362a1ad0a15a803722233575a3.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/.tmp 2023-07-20 07:10:49,813 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,,1689837049358.21bd4c362a1ad0a15a803722233575a3.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-20 07:10:49,813 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,1,1689837049358.151c29dd29443231c3428e1d11842a2b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-20 07:10:49,814 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1604): Closing 21bd4c362a1ad0a15a803722233575a3, disabling compactions & flushes 2023-07-20 07:10:49,814 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1604): Closing 151c29dd29443231c3428e1d11842a2b, disabling compactions & flushes 2023-07-20 07:10:49,814 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,,1689837049358.21bd4c362a1ad0a15a803722233575a3. 2023-07-20 07:10:49,814 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,1,1689837049358.151c29dd29443231c3428e1d11842a2b. 2023-07-20 07:10:49,814 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,,1689837049358.21bd4c362a1ad0a15a803722233575a3. 2023-07-20 07:10:49,814 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,1,1689837049358.151c29dd29443231c3428e1d11842a2b. 2023-07-20 07:10:49,814 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,,1689837049358.21bd4c362a1ad0a15a803722233575a3. after waiting 0 ms 2023-07-20 07:10:49,815 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,1,1689837049358.151c29dd29443231c3428e1d11842a2b. after waiting 0 ms 2023-07-20 07:10:49,815 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,,1689837049358.21bd4c362a1ad0a15a803722233575a3. 2023-07-20 07:10:49,815 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,1,1689837049358.151c29dd29443231c3428e1d11842a2b. 2023-07-20 07:10:49,815 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,,1689837049358.21bd4c362a1ad0a15a803722233575a3. 2023-07-20 07:10:49,815 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,1,1689837049358.151c29dd29443231c3428e1d11842a2b. 2023-07-20 07:10:49,815 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1558): Region close journal for 21bd4c362a1ad0a15a803722233575a3: 2023-07-20 07:10:49,815 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1558): Region close journal for 151c29dd29443231c3428e1d11842a2b: 2023-07-20 07:10:49,818 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_ADD_TO_META 2023-07-20 07:10:49,819 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,,1689837049358.21bd4c362a1ad0a15a803722233575a3.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689837049819"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689837049819"}]},"ts":"1689837049819"} 2023-07-20 07:10:49,819 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,1,1689837049358.151c29dd29443231c3428e1d11842a2b.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689837049819"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689837049819"}]},"ts":"1689837049819"} 2023-07-20 07:10:49,822 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-20 07:10:49,823 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-20 07:10:49,823 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689837049823"}]},"ts":"1689837049823"} 2023-07-20 07:10:49,824 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=ENABLING in hbase:meta 2023-07-20 07:10:49,827 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-20 07:10:49,829 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-20 07:10:49,829 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-20 07:10:49,829 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-20 07:10:49,829 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-20 07:10:49,829 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=21bd4c362a1ad0a15a803722233575a3, ASSIGN}, {pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=151c29dd29443231c3428e1d11842a2b, ASSIGN}] 2023-07-20 07:10:49,832 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=151c29dd29443231c3428e1d11842a2b, ASSIGN 2023-07-20 07:10:49,832 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=21bd4c362a1ad0a15a803722233575a3, ASSIGN 2023-07-20 07:10:49,833 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=151c29dd29443231c3428e1d11842a2b, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,45099,1689837020733; forceNewPlan=false, retain=false 2023-07-20 07:10:49,833 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=21bd4c362a1ad0a15a803722233575a3, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,44955,1689837020792; forceNewPlan=false, retain=false 2023-07-20 07:10:49,974 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-20 07:10:49,983 INFO [jenkins-hbase4:37415] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-20 07:10:49,986 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=151c29dd29443231c3428e1d11842a2b, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,45099,1689837020733 2023-07-20 07:10:49,986 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=21bd4c362a1ad0a15a803722233575a3, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,44955,1689837020792 2023-07-20 07:10:49,986 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,1,1689837049358.151c29dd29443231c3428e1d11842a2b.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689837049986"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689837049986"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689837049986"}]},"ts":"1689837049986"} 2023-07-20 07:10:49,987 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,,1689837049358.21bd4c362a1ad0a15a803722233575a3.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689837049986"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689837049986"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689837049986"}]},"ts":"1689837049986"} 2023-07-20 07:10:49,988 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=30, ppid=29, state=RUNNABLE; OpenRegionProcedure 151c29dd29443231c3428e1d11842a2b, server=jenkins-hbase4.apache.org,45099,1689837020733}] 2023-07-20 07:10:49,989 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=31, ppid=28, state=RUNNABLE; OpenRegionProcedure 21bd4c362a1ad0a15a803722233575a3, server=jenkins-hbase4.apache.org,44955,1689837020792}] 2023-07-20 07:10:50,151 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemState,,1689837049358.21bd4c362a1ad0a15a803722233575a3. 2023-07-20 07:10:50,152 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemState,1,1689837049358.151c29dd29443231c3428e1d11842a2b. 2023-07-20 07:10:50,152 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 21bd4c362a1ad0a15a803722233575a3, NAME => 'testtb-testExportFileSystemState,,1689837049358.21bd4c362a1ad0a15a803722233575a3.', STARTKEY => '', ENDKEY => '1'} 2023-07-20 07:10:50,152 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 151c29dd29443231c3428e1d11842a2b, NAME => 'testtb-testExportFileSystemState,1,1689837049358.151c29dd29443231c3428e1d11842a2b.', STARTKEY => '1', ENDKEY => ''} 2023-07-20 07:10:50,152 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemState,,1689837049358.21bd4c362a1ad0a15a803722233575a3. service=AccessControlService 2023-07-20 07:10:50,152 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemState,1,1689837049358.151c29dd29443231c3428e1d11842a2b. service=AccessControlService 2023-07-20 07:10:50,153 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-20 07:10:50,153 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-20 07:10:50,153 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemState 21bd4c362a1ad0a15a803722233575a3 2023-07-20 07:10:50,153 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemState 151c29dd29443231c3428e1d11842a2b 2023-07-20 07:10:50,153 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,,1689837049358.21bd4c362a1ad0a15a803722233575a3.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-20 07:10:50,153 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,1,1689837049358.151c29dd29443231c3428e1d11842a2b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-20 07:10:50,153 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 21bd4c362a1ad0a15a803722233575a3 2023-07-20 07:10:50,153 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 151c29dd29443231c3428e1d11842a2b 2023-07-20 07:10:50,153 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 21bd4c362a1ad0a15a803722233575a3 2023-07-20 07:10:50,153 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 151c29dd29443231c3428e1d11842a2b 2023-07-20 07:10:50,159 INFO [StoreOpener-151c29dd29443231c3428e1d11842a2b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 151c29dd29443231c3428e1d11842a2b 2023-07-20 07:10:50,159 INFO [StoreOpener-21bd4c362a1ad0a15a803722233575a3-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 21bd4c362a1ad0a15a803722233575a3 2023-07-20 07:10:50,160 DEBUG [StoreOpener-21bd4c362a1ad0a15a803722233575a3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/data/default/testtb-testExportFileSystemState/21bd4c362a1ad0a15a803722233575a3/cf 2023-07-20 07:10:50,160 DEBUG [StoreOpener-151c29dd29443231c3428e1d11842a2b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/data/default/testtb-testExportFileSystemState/151c29dd29443231c3428e1d11842a2b/cf 2023-07-20 07:10:50,161 DEBUG [StoreOpener-151c29dd29443231c3428e1d11842a2b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/data/default/testtb-testExportFileSystemState/151c29dd29443231c3428e1d11842a2b/cf 2023-07-20 07:10:50,161 DEBUG [StoreOpener-21bd4c362a1ad0a15a803722233575a3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/data/default/testtb-testExportFileSystemState/21bd4c362a1ad0a15a803722233575a3/cf 2023-07-20 07:10:50,161 INFO [StoreOpener-151c29dd29443231c3428e1d11842a2b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 151c29dd29443231c3428e1d11842a2b columnFamilyName cf 2023-07-20 07:10:50,161 INFO [StoreOpener-21bd4c362a1ad0a15a803722233575a3-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 21bd4c362a1ad0a15a803722233575a3 columnFamilyName cf 2023-07-20 07:10:50,163 INFO [StoreOpener-21bd4c362a1ad0a15a803722233575a3-1] regionserver.HStore(310): Store=21bd4c362a1ad0a15a803722233575a3/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-20 07:10:50,163 INFO [StoreOpener-151c29dd29443231c3428e1d11842a2b-1] regionserver.HStore(310): Store=151c29dd29443231c3428e1d11842a2b/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-20 07:10:50,165 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/data/default/testtb-testExportFileSystemState/21bd4c362a1ad0a15a803722233575a3 2023-07-20 07:10:50,166 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/data/default/testtb-testExportFileSystemState/151c29dd29443231c3428e1d11842a2b 2023-07-20 07:10:50,166 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/data/default/testtb-testExportFileSystemState/21bd4c362a1ad0a15a803722233575a3 2023-07-20 07:10:50,166 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/data/default/testtb-testExportFileSystemState/151c29dd29443231c3428e1d11842a2b 2023-07-20 07:10:50,170 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 21bd4c362a1ad0a15a803722233575a3 2023-07-20 07:10:50,170 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 151c29dd29443231c3428e1d11842a2b 2023-07-20 07:10:50,173 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/data/default/testtb-testExportFileSystemState/21bd4c362a1ad0a15a803722233575a3/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-20 07:10:50,173 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 21bd4c362a1ad0a15a803722233575a3; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66886267, jitterRate=-0.0033169537782669067}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-20 07:10:50,173 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 21bd4c362a1ad0a15a803722233575a3: 2023-07-20 07:10:50,174 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/data/default/testtb-testExportFileSystemState/151c29dd29443231c3428e1d11842a2b/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-20 07:10:50,175 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 151c29dd29443231c3428e1d11842a2b; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=75283040, jitterRate=0.12180471420288086}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-20 07:10:50,175 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 151c29dd29443231c3428e1d11842a2b: 2023-07-20 07:10:50,175 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemState,,1689837049358.21bd4c362a1ad0a15a803722233575a3., pid=31, masterSystemTime=1689837050144 2023-07-20 07:10:50,176 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemState,1,1689837049358.151c29dd29443231c3428e1d11842a2b., pid=30, masterSystemTime=1689837050141 2023-07-20 07:10:50,177 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemState,,1689837049358.21bd4c362a1ad0a15a803722233575a3. 2023-07-20 07:10:50,177 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemState,,1689837049358.21bd4c362a1ad0a15a803722233575a3. 2023-07-20 07:10:50,178 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=21bd4c362a1ad0a15a803722233575a3, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,44955,1689837020792 2023-07-20 07:10:50,178 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemState,,1689837049358.21bd4c362a1ad0a15a803722233575a3.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689837050178"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689837050178"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689837050178"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689837050178"}]},"ts":"1689837050178"} 2023-07-20 07:10:50,178 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemState,1,1689837049358.151c29dd29443231c3428e1d11842a2b. 2023-07-20 07:10:50,178 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemState,1,1689837049358.151c29dd29443231c3428e1d11842a2b. 2023-07-20 07:10:50,179 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=151c29dd29443231c3428e1d11842a2b, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,45099,1689837020733 2023-07-20 07:10:50,181 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemState,1,1689837049358.151c29dd29443231c3428e1d11842a2b.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689837050179"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689837050179"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689837050179"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689837050179"}]},"ts":"1689837050179"} 2023-07-20 07:10:50,185 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=31, resume processing ppid=28 2023-07-20 07:10:50,185 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=31, ppid=28, state=SUCCESS; OpenRegionProcedure 21bd4c362a1ad0a15a803722233575a3, server=jenkins-hbase4.apache.org,44955,1689837020792 in 193 msec 2023-07-20 07:10:50,186 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=30, resume processing ppid=29 2023-07-20 07:10:50,191 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=30, ppid=29, state=SUCCESS; OpenRegionProcedure 151c29dd29443231c3428e1d11842a2b, server=jenkins-hbase4.apache.org,45099,1689837020733 in 195 msec 2023-07-20 07:10:50,192 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=28, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=21bd4c362a1ad0a15a803722233575a3, ASSIGN in 356 msec 2023-07-20 07:10:50,194 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=29, resume processing ppid=27 2023-07-20 07:10:50,194 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=29, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=151c29dd29443231c3428e1d11842a2b, ASSIGN in 358 msec 2023-07-20 07:10:50,194 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-20 07:10:50,195 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689837050195"}]},"ts":"1689837050195"} 2023-07-20 07:10:50,196 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=ENABLED in hbase:meta 2023-07-20 07:10:50,199 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_POST_OPERATION 2023-07-20 07:10:50,199 DEBUG [PEWorker-3] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemState jenkins: RWXCA 2023-07-20 07:10:50,202 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=44955] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-07-20 07:10:50,204 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): regionserver:44777-0x10181911f0f0001, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-20 07:10:50,204 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): regionserver:45099-0x10181911f0f0002, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-20 07:10:50,204 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): regionserver:44955-0x10181911f0f0003, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-20 07:10:50,204 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): master:37415-0x10181911f0f0000, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-20 07:10:50,205 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-20 07:10:50,206 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-20 07:10:50,206 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-20 07:10:50,206 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-20 07:10:50,208 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=27, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemState in 845 msec 2023-07-20 07:10:50,475 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-20 07:10:50,476 INFO [Listener at jenkins-hbase4.apache.org/33837] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemState, procId: 27 completed 2023-07-20 07:10:50,480 DEBUG [Listener at jenkins-hbase4.apache.org/33837] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemState 2023-07-20 07:10:50,480 DEBUG [Listener at jenkins-hbase4.apache.org/33837] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemState,,1689837049358.21bd4c362a1ad0a15a803722233575a3. 2023-07-20 07:10:50,483 INFO [Listener at jenkins-hbase4.apache.org/33837] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-20 07:10:50,501 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-20 07:10:50,501 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689837050501 (current time:1689837050501). 2023-07-20 07:10:50,501 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-20 07:10:50,502 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] zookeeper.ReadOnlyZKClient(139): Connect 0x20f5bbd6 to 127.0.0.1:58010 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-20 07:10:50,510 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7e217cb5, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-20 07:10:50,511 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-20 07:10:50,513 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:50974, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-20 07:10:50,514 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x20f5bbd6 to 127.0.0.1:58010 2023-07-20 07:10:50,514 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-20 07:10:50,515 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] zookeeper.ReadOnlyZKClient(139): Connect 0x4a430e72 to 127.0.0.1:58010 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-20 07:10:50,528 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@47e527e7, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-20 07:10:50,530 DEBUG [hconnection-0x32d42f7a-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-20 07:10:50,534 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:50988, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-20 07:10:50,539 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-20 07:10:50,540 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:49122, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-20 07:10:50,541 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4a430e72 to 127.0.0.1:58010 2023-07-20 07:10:50,542 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-20 07:10:50,542 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-07-20 07:10:50,543 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-20 07:10:50,543 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-20 07:10:50,546 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] procedure2.ProcedureExecutor(1029): Stored pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-20 07:10:50,548 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-20 07:10:50,549 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=32, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1689837650549 2023-07-20 07:10:50,549 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-20 07:10:50,549 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState 2023-07-20 07:10:50,552 DEBUG [Listener at jenkins-hbase4.apache.org/33837] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-20 07:10:50,552 DEBUG [Listener at jenkins-hbase4.apache.org/33837] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-20 07:10:50,554 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=32, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-20 07:10:50,554 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=33, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-20 07:10:50,556 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=32, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE in 9 msec 2023-07-20 07:10:50,558 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=33, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-20 07:10:50,561 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=33, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED; timeout=600000, timestamp=1689837650561 2023-07-20 07:10:50,581 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemState 2023-07-20 07:10:50,582 INFO [(jenkins-hbase4.apache.org,37415,1689837019114)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemState' 2023-07-20 07:10:50,582 DEBUG [(jenkins-hbase4.apache.org,37415,1689837019114)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-20 07:10:50,583 DEBUG [(jenkins-hbase4.apache.org,37415,1689837019114)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' 2023-07-20 07:10:50,583 DEBUG [(jenkins-hbase4.apache.org,37415,1689837019114)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemState', kicking off acquire phase on members. 2023-07-20 07:10:50,584 DEBUG [(jenkins-hbase4.apache.org,37415,1689837019114)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37415-0x10181911f0f0000, quorum=127.0.0.1:58010, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-20 07:10:50,584 DEBUG [(jenkins-hbase4.apache.org,37415,1689837019114)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-20 07:10:50,585 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): regionserver:45099-0x10181911f0f0002, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 07:10:50,585 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): regionserver:44777-0x10181911f0f0001, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 07:10:50,585 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 07:10:50,586 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 07:10:50,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 07:10:50,585 DEBUG [(jenkins-hbase4.apache.org,37415,1689837019114)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45099,1689837020733 2023-07-20 07:10:50,585 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): regionserver:44955-0x10181911f0f0003, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 07:10:50,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 07:10:50,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-20 07:10:50,587 DEBUG [(jenkins-hbase4.apache.org,37415,1689837019114)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37415-0x10181911f0f0000, quorum=127.0.0.1:58010, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45099,1689837020733 2023-07-20 07:10:50,587 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 07:10:50,587 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44777-0x10181911f0f0001, quorum=127.0.0.1:58010, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-20 07:10:50,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 07:10:50,587 DEBUG [(jenkins-hbase4.apache.org,37415,1689837019114)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,44955,1689837020792 2023-07-20 07:10:50,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-20 07:10:50,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-07-20 07:10:50,587 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45099-0x10181911f0f0002, quorum=127.0.0.1:58010, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-20 07:10:50,587 DEBUG [(jenkins-hbase4.apache.org,37415,1689837019114)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37415-0x10181911f0f0000, quorum=127.0.0.1:58010, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,44955,1689837020792 2023-07-20 07:10:50,588 DEBUG [(jenkins-hbase4.apache.org,37415,1689837019114)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-20 07:10:50,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-20 07:10:50,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-20 07:10:50,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-07-20 07:10:50,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-20 07:10:50,588 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-20 07:10:50,588 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-20 07:10:50,588 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44955-0x10181911f0f0003, quorum=127.0.0.1:58010, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-20 07:10:50,588 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-07-20 07:10:50,588 DEBUG [member: 'jenkins-hbase4.apache.org,44777,1689837020621' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-20 07:10:50,588 DEBUG [member: 'jenkins-hbase4.apache.org,44777,1689837020621' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-20 07:10:50,590 DEBUG [member: 'jenkins-hbase4.apache.org,44777,1689837020621' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-20 07:10:50,590 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-07-20 07:10:50,590 DEBUG [member: 'jenkins-hbase4.apache.org,44777,1689837020621' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-07-20 07:10:50,590 DEBUG [member: 'jenkins-hbase4.apache.org,44777,1689837020621' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44777,1689837020621' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-07-20 07:10:50,590 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-07-20 07:10:50,590 DEBUG [member: 'jenkins-hbase4.apache.org,45099,1689837020733' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-20 07:10:50,590 DEBUG [member: 'jenkins-hbase4.apache.org,45099,1689837020733' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-20 07:10:50,590 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-20 07:10:50,592 DEBUG [member: 'jenkins-hbase4.apache.org,45099,1689837020733' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-20 07:10:50,592 DEBUG [member: 'jenkins-hbase4.apache.org,45099,1689837020733' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-07-20 07:10:50,592 DEBUG [member: 'jenkins-hbase4.apache.org,45099,1689837020733' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45099,1689837020733' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-07-20 07:10:50,592 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-20 07:10:50,593 DEBUG [member: 'jenkins-hbase4.apache.org,44777,1689837020621' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-20 07:10:50,595 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-07-20 07:10:50,595 DEBUG [member: 'jenkins-hbase4.apache.org,44955,1689837020792' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-20 07:10:50,595 DEBUG [member: 'jenkins-hbase4.apache.org,44955,1689837020792' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-20 07:10:50,596 DEBUG [member: 'jenkins-hbase4.apache.org,44955,1689837020792' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-20 07:10:50,596 DEBUG [member: 'jenkins-hbase4.apache.org,44955,1689837020792' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-07-20 07:10:50,596 DEBUG [member: 'jenkins-hbase4.apache.org,44955,1689837020792' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44955,1689837020792' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-07-20 07:10:50,604 DEBUG [member: 'jenkins-hbase4.apache.org,45099,1689837020733' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-20 07:10:50,605 DEBUG [member: 'jenkins-hbase4.apache.org,44777,1689837020621' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44777-0x10181911f0f0001, quorum=127.0.0.1:58010, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-20 07:10:50,605 DEBUG [member: 'jenkins-hbase4.apache.org,44777,1689837020621' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-20 07:10:50,605 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): master:37415-0x10181911f0f0000, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45099,1689837020733 2023-07-20 07:10:50,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45099,1689837020733 2023-07-20 07:10:50,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-20 07:10:50,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-20 07:10:50,606 DEBUG [member: 'jenkins-hbase4.apache.org,45099,1689837020733' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45099-0x10181911f0f0002, quorum=127.0.0.1:58010, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-20 07:10:50,606 DEBUG [member: 'jenkins-hbase4.apache.org,45099,1689837020733' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-20 07:10:50,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-20 07:10:50,607 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): master:37415-0x10181911f0f0000, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,44955,1689837020792 2023-07-20 07:10:50,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-20 07:10:50,607 DEBUG [member: 'jenkins-hbase4.apache.org,44955,1689837020792' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-20 07:10:50,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-20 07:10:50,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44955,1689837020792 2023-07-20 07:10:50,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44777,1689837020621 2023-07-20 07:10:50,609 DEBUG [member: 'jenkins-hbase4.apache.org,44955,1689837020792' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44955-0x10181911f0f0003, quorum=127.0.0.1:58010, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-20 07:10:50,609 DEBUG [member: 'jenkins-hbase4.apache.org,44955,1689837020792' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-20 07:10:50,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45099,1689837020733 2023-07-20 07:10:50,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-20 07:10:50,610 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,45099,1689837020733' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemState' on coordinator 2023-07-20 07:10:50,610 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@47168bb7[Count = 1] remaining members to acquire global barrier 2023-07-20 07:10:50,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,44955,1689837020792 2023-07-20 07:10:50,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-20 07:10:50,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-20 07:10:50,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-20 07:10:50,612 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-20 07:10:50,612 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-20 07:10:50,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44955,1689837020792 2023-07-20 07:10:50,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44777,1689837020621 2023-07-20 07:10:50,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45099,1689837020733 2023-07-20 07:10:50,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-20 07:10:50,614 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44955,1689837020792' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemState' on coordinator 2023-07-20 07:10:50,614 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@47168bb7[Count = 0] remaining members to acquire global barrier 2023-07-20 07:10:50,614 DEBUG [(jenkins-hbase4.apache.org,37415,1689837019114)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemState' starting 'in-barrier' execution. 2023-07-20 07:10:50,614 DEBUG [(jenkins-hbase4.apache.org,37415,1689837019114)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-20 07:10:50,617 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): regionserver:44777-0x10181911f0f0001, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-20 07:10:50,617 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): regionserver:44955-0x10181911f0f0003, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-20 07:10:50,617 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-20 07:10:50,617 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-20 07:10:50,617 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-20 07:10:50,617 DEBUG [(jenkins-hbase4.apache.org,37415,1689837019114)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37415-0x10181911f0f0000, quorum=127.0.0.1:58010, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45099,1689837020733 2023-07-20 07:10:50,617 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): regionserver:45099-0x10181911f0f0002, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-20 07:10:50,617 DEBUG [member: 'jenkins-hbase4.apache.org,44955,1689837020792' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-20 07:10:50,617 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-20 07:10:50,617 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-20 07:10:50,618 DEBUG [member: 'jenkins-hbase4.apache.org,45099,1689837020733' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-20 07:10:50,617 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-20 07:10:50,618 DEBUG [member: 'jenkins-hbase4.apache.org,44777,1689837020621' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-20 07:10:50,618 DEBUG [member: 'jenkins-hbase4.apache.org,44777,1689837020621' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-07-20 07:10:50,618 DEBUG [member: 'jenkins-hbase4.apache.org,44777,1689837020621' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,44777,1689837020621' in zk 2023-07-20 07:10:50,618 DEBUG [(jenkins-hbase4.apache.org,37415,1689837019114)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37415-0x10181911f0f0000, quorum=127.0.0.1:58010, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,44955,1689837020792 2023-07-20 07:10:50,618 DEBUG [(jenkins-hbase4.apache.org,37415,1689837019114)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-20 07:10:50,619 DEBUG [member: 'jenkins-hbase4.apache.org,44777,1689837020621' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-07-20 07:10:50,619 DEBUG [member: 'jenkins-hbase4.apache.org,44777,1689837020621' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-20 07:10:50,620 DEBUG [member: 'jenkins-hbase4.apache.org,44777,1689837020621' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-07-20 07:10:50,625 DEBUG [member: 'jenkins-hbase4.apache.org,44955,1689837020792' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-20 07:10:50,625 DEBUG [member: 'jenkins-hbase4.apache.org,44955,1689837020792' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-20 07:10:50,626 DEBUG [rs(jenkins-hbase4.apache.org,44955,1689837020792)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,,1689837049358.21bd4c362a1ad0a15a803722233575a3. 2023-07-20 07:10:50,626 DEBUG [rs(jenkins-hbase4.apache.org,44955,1689837020792)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,,1689837049358.21bd4c362a1ad0a15a803722233575a3. started... 2023-07-20 07:10:50,626 DEBUG [rs(jenkins-hbase4.apache.org,44955,1689837020792)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 21bd4c362a1ad0a15a803722233575a3: 2023-07-20 07:10:50,626 DEBUG [rs(jenkins-hbase4.apache.org,44955,1689837020792)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,,1689837049358.21bd4c362a1ad0a15a803722233575a3.' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-07-20 07:10:50,626 DEBUG [rs(jenkins-hbase4.apache.org,44955,1689837020792)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-20 07:10:50,627 DEBUG [rs(jenkins-hbase4.apache.org,44955,1689837020792)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-20 07:10:50,629 DEBUG [member: 'jenkins-hbase4.apache.org,45099,1689837020733' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-20 07:10:50,629 DEBUG [member: 'jenkins-hbase4.apache.org,45099,1689837020733' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-20 07:10:50,629 DEBUG [rs(jenkins-hbase4.apache.org,45099,1689837020733)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,1,1689837049358.151c29dd29443231c3428e1d11842a2b. 2023-07-20 07:10:50,629 DEBUG [rs(jenkins-hbase4.apache.org,45099,1689837020733)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,1,1689837049358.151c29dd29443231c3428e1d11842a2b. started... 2023-07-20 07:10:50,631 DEBUG [rs(jenkins-hbase4.apache.org,45099,1689837020733)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 151c29dd29443231c3428e1d11842a2b: 2023-07-20 07:10:50,631 DEBUG [rs(jenkins-hbase4.apache.org,45099,1689837020733)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,1,1689837049358.151c29dd29443231c3428e1d11842a2b.' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-07-20 07:10:50,631 DEBUG [rs(jenkins-hbase4.apache.org,45099,1689837020733)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-20 07:10:50,631 DEBUG [rs(jenkins-hbase4.apache.org,45099,1689837020733)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-20 07:10:50,654 DEBUG [Listener at jenkins-hbase4.apache.org/33837] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-20 07:10:50,655 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-20 07:10:50,655 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-20 07:10:50,656 DEBUG [Listener at jenkins-hbase4.apache.org/33837] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-20 07:10:50,678 DEBUG [rs(jenkins-hbase4.apache.org,44955,1689837020792)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,,1689837049358.21bd4c362a1ad0a15a803722233575a3. completed. 2023-07-20 07:10:50,678 DEBUG [rs(jenkins-hbase4.apache.org,44955,1689837020792)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,,1689837049358.21bd4c362a1ad0a15a803722233575a3. 2023-07-20 07:10:50,678 DEBUG [member: 'jenkins-hbase4.apache.org,44955,1689837020792' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-20 07:10:50,678 DEBUG [member: 'jenkins-hbase4.apache.org,44955,1689837020792' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-20 07:10:50,678 DEBUG [member: 'jenkins-hbase4.apache.org,44955,1689837020792' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,44955,1689837020792 2023-07-20 07:10:50,678 DEBUG [member: 'jenkins-hbase4.apache.org,44955,1689837020792' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-07-20 07:10:50,678 DEBUG [member: 'jenkins-hbase4.apache.org,44955,1689837020792' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,44955,1689837020792' in zk 2023-07-20 07:10:50,681 DEBUG [member: 'jenkins-hbase4.apache.org,44955,1689837020792' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-07-20 07:10:50,681 DEBUG [member: 'jenkins-hbase4.apache.org,44955,1689837020792' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-20 07:10:50,681 DEBUG [member: 'jenkins-hbase4.apache.org,44955,1689837020792' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-07-20 07:10:50,681 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): master:37415-0x10181911f0f0000, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,44955,1689837020792 2023-07-20 07:10:50,681 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,44955,1689837020792 2023-07-20 07:10:50,681 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-20 07:10:50,681 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-20 07:10:50,684 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-20 07:10:50,684 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-20 07:10:50,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-20 07:10:50,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44955,1689837020792 2023-07-20 07:10:50,686 DEBUG [rs(jenkins-hbase4.apache.org,45099,1689837020733)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,1,1689837049358.151c29dd29443231c3428e1d11842a2b. completed. 2023-07-20 07:10:50,686 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44777,1689837020621 2023-07-20 07:10:50,686 DEBUG [rs(jenkins-hbase4.apache.org,45099,1689837020733)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,1,1689837049358.151c29dd29443231c3428e1d11842a2b. 2023-07-20 07:10:50,686 DEBUG [member: 'jenkins-hbase4.apache.org,45099,1689837020733' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-20 07:10:50,686 DEBUG [member: 'jenkins-hbase4.apache.org,45099,1689837020733' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-20 07:10:50,686 DEBUG [member: 'jenkins-hbase4.apache.org,45099,1689837020733' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,45099,1689837020733 2023-07-20 07:10:50,686 DEBUG [member: 'jenkins-hbase4.apache.org,45099,1689837020733' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-07-20 07:10:50,686 DEBUG [member: 'jenkins-hbase4.apache.org,45099,1689837020733' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,45099,1689837020733' in zk 2023-07-20 07:10:50,687 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45099,1689837020733 2023-07-20 07:10:50,688 DEBUG [member: 'jenkins-hbase4.apache.org,45099,1689837020733' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-07-20 07:10:50,688 DEBUG [member: 'jenkins-hbase4.apache.org,45099,1689837020733' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-20 07:10:50,688 DEBUG [member: 'jenkins-hbase4.apache.org,45099,1689837020733' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-07-20 07:10:50,688 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): master:37415-0x10181911f0f0000, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45099,1689837020733 2023-07-20 07:10:50,690 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-20 07:10:50,691 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-20 07:10:50,691 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44955,1689837020792 2023-07-20 07:10:50,692 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44777,1689837020621 2023-07-20 07:10:50,692 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45099,1689837020733 2023-07-20 07:10:50,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,44955,1689837020792': 2023-07-20 07:10:50,693 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44955,1689837020792' released barrier for procedure'emptySnaptb0-testExportFileSystemState', counting down latch. Waiting for 1 more 2023-07-20 07:10:50,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45099,1689837020733 2023-07-20 07:10:50,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-20 07:10:50,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-20 07:10:50,694 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-20 07:10:50,694 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-20 07:10:50,694 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-20 07:10:50,695 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44955,1689837020792 2023-07-20 07:10:50,695 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44777,1689837020621 2023-07-20 07:10:50,696 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45099,1689837020733 2023-07-20 07:10:50,696 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-20 07:10:50,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-20 07:10:50,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44955,1689837020792 2023-07-20 07:10:50,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44777,1689837020621 2023-07-20 07:10:50,699 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45099,1689837020733 2023-07-20 07:10:50,699 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,45099,1689837020733': 2023-07-20 07:10:50,699 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,45099,1689837020733' released barrier for procedure'emptySnaptb0-testExportFileSystemState', counting down latch. Waiting for 0 more 2023-07-20 07:10:50,700 INFO [(jenkins-hbase4.apache.org,37415,1689837019114)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemState' execution completed 2023-07-20 07:10:50,700 DEBUG [(jenkins-hbase4.apache.org,37415,1689837019114)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-20 07:10:50,700 DEBUG [(jenkins-hbase4.apache.org,37415,1689837019114)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-20 07:10:50,700 DEBUG [(jenkins-hbase4.apache.org,37415,1689837019114)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemState 2023-07-20 07:10:50,700 INFO [(jenkins-hbase4.apache.org,37415,1689837019114)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-20 07:10:50,704 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): master:37415-0x10181911f0f0000, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-20 07:10:50,705 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): regionserver:45099-0x10181911f0f0002, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-20 07:10:50,705 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): regionserver:45099-0x10181911f0f0002, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 07:10:50,705 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-20 07:10:50,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-20 07:10:50,704 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): regionserver:44955-0x10181911f0f0003, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-20 07:10:50,705 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): regionserver:44955-0x10181911f0f0003, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 07:10:50,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-20 07:10:50,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-20 07:10:50,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-20 07:10:50,705 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-20 07:10:50,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-20 07:10:50,705 DEBUG [(jenkins-hbase4.apache.org,37415,1689837019114)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37415-0x10181911f0f0000, quorum=127.0.0.1:58010, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,44955,1689837020792 2023-07-20 07:10:50,706 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 07:10:50,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 07:10:50,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-20 07:10:50,706 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 07:10:50,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 07:10:50,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-20 07:10:50,707 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): regionserver:44777-0x10181911f0f0001, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-20 07:10:50,707 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): regionserver:44777-0x10181911f0f0001, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 07:10:50,707 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-20 07:10:50,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-20 07:10:50,707 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 07:10:50,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 07:10:50,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-20 07:10:50,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-20 07:10:50,711 DEBUG [(jenkins-hbase4.apache.org,37415,1689837019114)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37415-0x10181911f0f0000, quorum=127.0.0.1:58010, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,44777,1689837020621 2023-07-20 07:10:50,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-20 07:10:50,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-20 07:10:50,711 DEBUG [(jenkins-hbase4.apache.org,37415,1689837019114)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37415-0x10181911f0f0000, quorum=127.0.0.1:58010, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45099,1689837020733 2023-07-20 07:10:50,712 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-20 07:10:50,712 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44955,1689837020792 2023-07-20 07:10:50,712 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44777,1689837020621 2023-07-20 07:10:50,713 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45099,1689837020733 2023-07-20 07:10:50,713 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-20 07:10:50,714 DEBUG [(jenkins-hbase4.apache.org,37415,1689837019114)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37415-0x10181911f0f0000, quorum=127.0.0.1:58010, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,44955,1689837020792 2023-07-20 07:10:50,714 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-20 07:10:50,714 DEBUG [(jenkins-hbase4.apache.org,37415,1689837019114)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37415-0x10181911f0f0000, quorum=127.0.0.1:58010, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,44777,1689837020621 2023-07-20 07:10:50,714 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44955,1689837020792 2023-07-20 07:10:50,715 DEBUG [(jenkins-hbase4.apache.org,37415,1689837019114)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37415-0x10181911f0f0000, quorum=127.0.0.1:58010, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45099,1689837020733 2023-07-20 07:10:50,715 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44777,1689837020621 2023-07-20 07:10:50,716 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45099,1689837020733 2023-07-20 07:10:50,721 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): regionserver:45099-0x10181911f0f0002, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 07:10:50,721 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): master:37415-0x10181911f0f0000, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45099,1689837020733 2023-07-20 07:10:50,721 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): regionserver:44777-0x10181911f0f0001, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 07:10:50,721 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): master:37415-0x10181911f0f0000, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-20 07:10:50,721 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 07:10:50,722 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 07:10:50,722 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemState 2023-07-20 07:10:50,721 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): master:37415-0x10181911f0f0000, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,44777,1689837020621 2023-07-20 07:10:50,721 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): regionserver:44777-0x10181911f0f0001, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 07:10:50,721 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): regionserver:45099-0x10181911f0f0002, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 07:10:50,721 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): regionserver:44955-0x10181911f0f0003, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 07:10:50,722 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): master:37415-0x10181911f0f0000, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,44955,1689837020792 2023-07-20 07:10:50,722 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): regionserver:44955-0x10181911f0f0003, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 07:10:50,722 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): master:37415-0x10181911f0f0000, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-20 07:10:50,722 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 07:10:50,722 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 07:10:50,722 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemState 2023-07-20 07:10:50,722 DEBUG [(jenkins-hbase4.apache.org,37415,1689837019114)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-20 07:10:50,722 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 07:10:50,722 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 8c2558c0b59bb3a4e2e578c2c8e8915d, NAME => 'testtb-testExportFileSystemState,.mob,0.8c2558c0b59bb3a4e2e578c2c8e8915d.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-07-20 07:10:50,722 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): master:37415-0x10181911f0f0000, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45099,1689837020733 2023-07-20 07:10:50,724 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-20 07:10:50,722 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 07:10:50,724 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): master:37415-0x10181911f0f0000, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-20 07:10:50,724 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 07:10:50,724 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): master:37415-0x10181911f0f0000, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,44777,1689837020621 2023-07-20 07:10:50,724 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 07:10:50,724 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): master:37415-0x10181911f0f0000, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,44955,1689837020792 2023-07-20 07:10:50,724 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): master:37415-0x10181911f0f0000, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-20 07:10:50,724 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): master:37415-0x10181911f0f0000, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-20 07:10:50,724 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 07:10:50,724 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 07:10:50,725 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 07:10:50,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 07:10:50,725 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-07-20 07:10:50,746 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemState 2023-07-20 07:10:50,747 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-07-20 07:10:50,825 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState to hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/.hbase-snapshot/emptySnaptb0-testExportFileSystemState 2023-07-20 07:10:50,855 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed 2023-07-20 07:10:50,855 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-07-20 07:10:50,856 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-07-20 07:10:50,856 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState at 1689837050550Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemState at 1689837050746 (+196 ms)Consolidate snapshot: emptySnaptb0-testExportFileSystemState at 1689837050746Loading Region manifests for emptySnaptb0-testExportFileSystemState at 1689837050746Writing data manifest for emptySnaptb0-testExportFileSystemState at 1689837050762 (+16 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemState at 1689837050805 (+43 ms)Snapshot emptySnaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed at 1689837050855 (+50 ms) 2023-07-20 07:10:50,857 DEBUG [Listener at jenkins-hbase4.apache.org/33837] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-20 07:10:50,859 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=33, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-20 07:10:50,860 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-20 07:10:50,860 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-20 07:10:50,861 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=33, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED in 308 msec 2023-07-20 07:10:50,863 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44955] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemState,,1689837049358.21bd4c362a1ad0a15a803722233575a3. with WAL disabled. Data may be lost in the event of a crash. 2023-07-20 07:10:50,866 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45099] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemState,1,1689837049358.151c29dd29443231c3428e1d11842a2b. with WAL disabled. Data may be lost in the event of a crash. 2023-07-20 07:10:50,869 DEBUG [Listener at jenkins-hbase4.apache.org/33837] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemState 2023-07-20 07:10:50,869 DEBUG [Listener at jenkins-hbase4.apache.org/33837] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemState,,1689837049358.21bd4c362a1ad0a15a803722233575a3. 2023-07-20 07:10:50,870 INFO [Listener at jenkins-hbase4.apache.org/33837] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-20 07:10:50,882 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-20 07:10:50,883 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689837050883 (current time:1689837050883). 2023-07-20 07:10:50,883 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-20 07:10:50,883 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] zookeeper.ReadOnlyZKClient(139): Connect 0x00e63161 to 127.0.0.1:58010 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-20 07:10:50,890 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4fb38180, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-20 07:10:50,892 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-20 07:10:50,895 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:51002, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-20 07:10:50,896 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x00e63161 to 127.0.0.1:58010 2023-07-20 07:10:50,896 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-20 07:10:50,896 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] zookeeper.ReadOnlyZKClient(139): Connect 0x071d8422 to 127.0.0.1:58010 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-20 07:10:50,906 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@65adf840, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-20 07:10:50,907 DEBUG [hconnection-0x7ca108d9-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-20 07:10:50,909 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:51012, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-20 07:10:50,914 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-20 07:10:50,917 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:49134, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-20 07:10:50,919 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x071d8422 to 127.0.0.1:58010 2023-07-20 07:10:50,919 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-20 07:10:50,919 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-07-20 07:10:50,920 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-20 07:10:50,920 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-20 07:10:50,923 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] procedure2.ProcedureExecutor(1029): Stored pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-20 07:10:50,924 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-20 07:10:50,925 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=34, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1689837650925 2023-07-20 07:10:50,925 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState 2023-07-20 07:10:50,925 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-20 07:10:50,927 DEBUG [Listener at jenkins-hbase4.apache.org/33837] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-20 07:10:50,927 DEBUG [Listener at jenkins-hbase4.apache.org/33837] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-20 07:10:50,928 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=35, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-20 07:10:50,929 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=34, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-20 07:10:50,931 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=34, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE in 8 msec 2023-07-20 07:10:50,932 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=35, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-20 07:10:50,933 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=35, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED; timeout=600000, timestamp=1689837650933 2023-07-20 07:10:50,947 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemState 2023-07-20 07:10:50,947 INFO [(jenkins-hbase4.apache.org,37415,1689837019114)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemState' 2023-07-20 07:10:50,947 DEBUG [(jenkins-hbase4.apache.org,37415,1689837019114)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-20 07:10:50,949 DEBUG [(jenkins-hbase4.apache.org,37415,1689837019114)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemState' starting 'acquire' 2023-07-20 07:10:50,949 DEBUG [(jenkins-hbase4.apache.org,37415,1689837019114)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemState', kicking off acquire phase on members. 2023-07-20 07:10:50,949 DEBUG [(jenkins-hbase4.apache.org,37415,1689837019114)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37415-0x10181911f0f0000, quorum=127.0.0.1:58010, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-20 07:10:50,949 DEBUG [(jenkins-hbase4.apache.org,37415,1689837019114)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-20 07:10:50,950 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): regionserver:45099-0x10181911f0f0002, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 07:10:50,950 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): regionserver:44955-0x10181911f0f0003, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 07:10:50,951 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 07:10:50,951 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 07:10:50,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 07:10:50,950 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): regionserver:44777-0x10181911f0f0001, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 07:10:50,950 DEBUG [(jenkins-hbase4.apache.org,37415,1689837019114)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45099,1689837020733 2023-07-20 07:10:50,951 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 07:10:50,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 07:10:50,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 07:10:50,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-20 07:10:50,951 DEBUG [(jenkins-hbase4.apache.org,37415,1689837019114)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37415-0x10181911f0f0000, quorum=127.0.0.1:58010, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45099,1689837020733 2023-07-20 07:10:50,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-20 07:10:50,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-20 07:10:50,951 DEBUG [(jenkins-hbase4.apache.org,37415,1689837019114)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,44955,1689837020792 2023-07-20 07:10:50,951 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44955-0x10181911f0f0003, quorum=127.0.0.1:58010, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-20 07:10:50,952 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45099-0x10181911f0f0002, quorum=127.0.0.1:58010, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-20 07:10:50,952 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44777-0x10181911f0f0001, quorum=127.0.0.1:58010, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-20 07:10:50,952 DEBUG [(jenkins-hbase4.apache.org,37415,1689837019114)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37415-0x10181911f0f0000, quorum=127.0.0.1:58010, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,44955,1689837020792 2023-07-20 07:10:50,952 DEBUG [(jenkins-hbase4.apache.org,37415,1689837019114)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-20 07:10:50,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-07-20 07:10:50,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-20 07:10:50,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-07-20 07:10:50,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-20 07:10:50,952 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-20 07:10:50,952 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-20 07:10:50,952 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-07-20 07:10:50,952 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-07-20 07:10:50,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-07-20 07:10:50,953 DEBUG [member: 'jenkins-hbase4.apache.org,44955,1689837020792' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-20 07:10:50,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-20 07:10:50,953 DEBUG [member: 'jenkins-hbase4.apache.org,45099,1689837020733' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-20 07:10:50,953 DEBUG [member: 'jenkins-hbase4.apache.org,45099,1689837020733' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-20 07:10:50,953 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-20 07:10:50,953 DEBUG [member: 'jenkins-hbase4.apache.org,44955,1689837020792' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-20 07:10:50,954 DEBUG [member: 'jenkins-hbase4.apache.org,45099,1689837020733' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-20 07:10:50,954 DEBUG [member: 'jenkins-hbase4.apache.org,45099,1689837020733' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-07-20 07:10:50,954 DEBUG [member: 'jenkins-hbase4.apache.org,45099,1689837020733' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45099,1689837020733' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-07-20 07:10:50,956 DEBUG [member: 'jenkins-hbase4.apache.org,44955,1689837020792' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-20 07:10:50,956 DEBUG [member: 'jenkins-hbase4.apache.org,44955,1689837020792' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-07-20 07:10:50,956 DEBUG [member: 'jenkins-hbase4.apache.org,44955,1689837020792' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44955,1689837020792' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-07-20 07:10:50,956 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-07-20 07:10:50,956 DEBUG [member: 'jenkins-hbase4.apache.org,44777,1689837020621' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-20 07:10:50,956 DEBUG [member: 'jenkins-hbase4.apache.org,44777,1689837020621' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-20 07:10:50,957 DEBUG [member: 'jenkins-hbase4.apache.org,44777,1689837020621' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-20 07:10:50,957 DEBUG [member: 'jenkins-hbase4.apache.org,44777,1689837020621' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-07-20 07:10:50,957 DEBUG [member: 'jenkins-hbase4.apache.org,44777,1689837020621' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44777,1689837020621' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-07-20 07:10:50,959 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): master:37415-0x10181911f0f0000, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,44955,1689837020792 2023-07-20 07:10:50,959 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): master:37415-0x10181911f0f0000, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45099,1689837020733 2023-07-20 07:10:50,959 DEBUG [member: 'jenkins-hbase4.apache.org,45099,1689837020733' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-20 07:10:50,959 DEBUG [member: 'jenkins-hbase4.apache.org,44955,1689837020792' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-20 07:10:50,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,44955,1689837020792 2023-07-20 07:10:50,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-20 07:10:50,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-20 07:10:50,960 DEBUG [member: 'jenkins-hbase4.apache.org,45099,1689837020733' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45099-0x10181911f0f0002, quorum=127.0.0.1:58010, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-20 07:10:50,960 DEBUG [member: 'jenkins-hbase4.apache.org,44955,1689837020792' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44955-0x10181911f0f0003, quorum=127.0.0.1:58010, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-20 07:10:50,960 DEBUG [member: 'jenkins-hbase4.apache.org,45099,1689837020733' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-20 07:10:50,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-20 07:10:50,960 DEBUG [member: 'jenkins-hbase4.apache.org,44777,1689837020621' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-20 07:10:50,960 DEBUG [member: 'jenkins-hbase4.apache.org,44955,1689837020792' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-20 07:10:50,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-20 07:10:50,961 DEBUG [member: 'jenkins-hbase4.apache.org,44777,1689837020621' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44777-0x10181911f0f0001, quorum=127.0.0.1:58010, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-20 07:10:50,961 DEBUG [member: 'jenkins-hbase4.apache.org,44777,1689837020621' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-20 07:10:50,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-20 07:10:50,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44955,1689837020792 2023-07-20 07:10:50,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44777,1689837020621 2023-07-20 07:10:50,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45099,1689837020733 2023-07-20 07:10:50,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-20 07:10:50,962 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44955,1689837020792' joining acquired barrier for procedure 'snaptb0-testExportFileSystemState' on coordinator 2023-07-20 07:10:50,962 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@38792d90[Count = 1] remaining members to acquire global barrier 2023-07-20 07:10:50,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45099,1689837020733 2023-07-20 07:10:50,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-20 07:10:50,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-20 07:10:50,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-20 07:10:50,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-20 07:10:50,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-20 07:10:50,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44955,1689837020792 2023-07-20 07:10:50,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44777,1689837020621 2023-07-20 07:10:50,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45099,1689837020733 2023-07-20 07:10:50,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-20 07:10:50,964 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,45099,1689837020733' joining acquired barrier for procedure 'snaptb0-testExportFileSystemState' on coordinator 2023-07-20 07:10:50,964 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@38792d90[Count = 0] remaining members to acquire global barrier 2023-07-20 07:10:50,964 DEBUG [(jenkins-hbase4.apache.org,37415,1689837019114)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemState' starting 'in-barrier' execution. 2023-07-20 07:10:50,964 DEBUG [(jenkins-hbase4.apache.org,37415,1689837019114)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-20 07:10:50,966 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): regionserver:45099-0x10181911f0f0002, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-20 07:10:50,966 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): regionserver:44955-0x10181911f0f0003, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-20 07:10:50,966 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-20 07:10:50,966 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-20 07:10:50,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-20 07:10:50,966 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): regionserver:44777-0x10181911f0f0001, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-20 07:10:50,967 DEBUG [member: 'jenkins-hbase4.apache.org,45099,1689837020733' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-20 07:10:50,967 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-20 07:10:50,967 DEBUG [(jenkins-hbase4.apache.org,37415,1689837019114)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37415-0x10181911f0f0000, quorum=127.0.0.1:58010, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,44955,1689837020792 2023-07-20 07:10:50,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-20 07:10:50,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-20 07:10:50,967 DEBUG [member: 'jenkins-hbase4.apache.org,45099,1689837020733' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-20 07:10:50,967 DEBUG [member: 'jenkins-hbase4.apache.org,44777,1689837020621' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-20 07:10:50,967 DEBUG [rs(jenkins-hbase4.apache.org,45099,1689837020733)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,1,1689837049358.151c29dd29443231c3428e1d11842a2b. 2023-07-20 07:10:50,967 DEBUG [member: 'jenkins-hbase4.apache.org,44777,1689837020621' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-07-20 07:10:50,967 DEBUG [rs(jenkins-hbase4.apache.org,45099,1689837020733)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,1,1689837049358.151c29dd29443231c3428e1d11842a2b. started... 2023-07-20 07:10:50,967 DEBUG [member: 'jenkins-hbase4.apache.org,45099,1689837020733' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-20 07:10:50,967 DEBUG [member: 'jenkins-hbase4.apache.org,44955,1689837020792' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-20 07:10:50,967 DEBUG [member: 'jenkins-hbase4.apache.org,44777,1689837020621' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,44777,1689837020621' in zk 2023-07-20 07:10:50,967 DEBUG [(jenkins-hbase4.apache.org,37415,1689837019114)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37415-0x10181911f0f0000, quorum=127.0.0.1:58010, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45099,1689837020733 2023-07-20 07:10:50,967 DEBUG [(jenkins-hbase4.apache.org,37415,1689837019114)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-20 07:10:50,967 INFO [rs(jenkins-hbase4.apache.org,45099,1689837020733)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 151c29dd29443231c3428e1d11842a2b 1/1 column families, dataSize=3.06 KB heapSize=6.86 KB 2023-07-20 07:10:50,967 DEBUG [member: 'jenkins-hbase4.apache.org,44955,1689837020792' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-20 07:10:50,967 DEBUG [member: 'jenkins-hbase4.apache.org,44955,1689837020792' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-20 07:10:50,967 DEBUG [rs(jenkins-hbase4.apache.org,44955,1689837020792)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,,1689837049358.21bd4c362a1ad0a15a803722233575a3. 2023-07-20 07:10:50,968 DEBUG [rs(jenkins-hbase4.apache.org,44955,1689837020792)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,,1689837049358.21bd4c362a1ad0a15a803722233575a3. started... 2023-07-20 07:10:50,968 INFO [rs(jenkins-hbase4.apache.org,44955,1689837020792)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 21bd4c362a1ad0a15a803722233575a3 1/1 column families, dataSize=199 B heapSize=688 B 2023-07-20 07:10:50,969 DEBUG [member: 'jenkins-hbase4.apache.org,44777,1689837020621' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-07-20 07:10:50,969 DEBUG [member: 'jenkins-hbase4.apache.org,44777,1689837020621' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-20 07:10:50,969 DEBUG [member: 'jenkins-hbase4.apache.org,44777,1689837020621' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-07-20 07:10:50,994 INFO [rs(jenkins-hbase4.apache.org,45099,1689837020733)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230720eb748dd401c048e3b4f112c9a33ec414 to hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b20230720eb748dd401c048e3b4f112c9a33ec414 2023-07-20 07:10:50,994 INFO [rs(jenkins-hbase4.apache.org,44955,1689837020792)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230720a60279b0e9d34f42a3e5f2bc554a14be to hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e20230720a60279b0e9d34f42a3e5f2bc554a14be 2023-07-20 07:10:51,017 INFO [rs(jenkins-hbase4.apache.org,44955,1689837020792)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=199, hasBloomFilter=true, into tmp file hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/data/default/testtb-testExportFileSystemState/21bd4c362a1ad0a15a803722233575a3/.tmp/cf/cb4ab35dc8cc4d2da85a968d45ca174f 2023-07-20 07:10:51,020 INFO [rs(jenkins-hbase4.apache.org,45099,1689837020733)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/data/default/testtb-testExportFileSystemState/151c29dd29443231c3428e1d11842a2b/.tmp/cf/0deb929f82464676864f9e0ac1f73cd3 2023-07-20 07:10:51,025 DEBUG [rs(jenkins-hbase4.apache.org,44955,1689837020792)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/data/default/testtb-testExportFileSystemState/21bd4c362a1ad0a15a803722233575a3/.tmp/cf/cb4ab35dc8cc4d2da85a968d45ca174f as hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/data/default/testtb-testExportFileSystemState/21bd4c362a1ad0a15a803722233575a3/cf/cb4ab35dc8cc4d2da85a968d45ca174f 2023-07-20 07:10:51,027 DEBUG [rs(jenkins-hbase4.apache.org,45099,1689837020733)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/data/default/testtb-testExportFileSystemState/151c29dd29443231c3428e1d11842a2b/.tmp/cf/0deb929f82464676864f9e0ac1f73cd3 as hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/data/default/testtb-testExportFileSystemState/151c29dd29443231c3428e1d11842a2b/cf/0deb929f82464676864f9e0ac1f73cd3 2023-07-20 07:10:51,027 DEBUG [Listener at jenkins-hbase4.apache.org/33837] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-20 07:10:51,028 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-20 07:10:51,029 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-20 07:10:51,029 DEBUG [Listener at jenkins-hbase4.apache.org/33837] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-20 07:10:51,032 INFO [rs(jenkins-hbase4.apache.org,44955,1689837020792)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/data/default/testtb-testExportFileSystemState/21bd4c362a1ad0a15a803722233575a3/cf/cb4ab35dc8cc4d2da85a968d45ca174f, entries=3, sequenceid=6, filesize=5.4 K 2023-07-20 07:10:51,033 INFO [rs(jenkins-hbase4.apache.org,44955,1689837020792)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~199 B/199, heapSize ~672 B/672, currentSize=0 B/0 for 21bd4c362a1ad0a15a803722233575a3 in 65ms, sequenceid=6, compaction requested=false 2023-07-20 07:10:51,033 DEBUG [rs(jenkins-hbase4.apache.org,44955,1689837020792)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemState' 2023-07-20 07:10:51,033 INFO [rs(jenkins-hbase4.apache.org,45099,1689837020733)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/data/default/testtb-testExportFileSystemState/151c29dd29443231c3428e1d11842a2b/cf/0deb929f82464676864f9e0ac1f73cd3, entries=47, sequenceid=6, filesize=12.8 K 2023-07-20 07:10:51,034 DEBUG [rs(jenkins-hbase4.apache.org,44955,1689837020792)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 21bd4c362a1ad0a15a803722233575a3: 2023-07-20 07:10:51,034 DEBUG [rs(jenkins-hbase4.apache.org,44955,1689837020792)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,,1689837049358.21bd4c362a1ad0a15a803722233575a3.' region-info for snapshot=snaptb0-testExportFileSystemState 2023-07-20 07:10:51,034 DEBUG [rs(jenkins-hbase4.apache.org,44955,1689837020792)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-20 07:10:51,034 DEBUG [rs(jenkins-hbase4.apache.org,44955,1689837020792)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/data/default/testtb-testExportFileSystemState/21bd4c362a1ad0a15a803722233575a3/cf/cb4ab35dc8cc4d2da85a968d45ca174f] hfiles 2023-07-20 07:10:51,034 DEBUG [rs(jenkins-hbase4.apache.org,44955,1689837020792)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/data/default/testtb-testExportFileSystemState/21bd4c362a1ad0a15a803722233575a3/cf/cb4ab35dc8cc4d2da85a968d45ca174f for snapshot=snaptb0-testExportFileSystemState 2023-07-20 07:10:51,035 INFO [rs(jenkins-hbase4.apache.org,45099,1689837020733)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.06 KB/3137, heapSize ~6.84 KB/7008, currentSize=0 B/0 for 151c29dd29443231c3428e1d11842a2b in 68ms, sequenceid=6, compaction requested=false 2023-07-20 07:10:51,037 DEBUG [rs(jenkins-hbase4.apache.org,45099,1689837020733)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 151c29dd29443231c3428e1d11842a2b: 2023-07-20 07:10:51,037 DEBUG [rs(jenkins-hbase4.apache.org,45099,1689837020733)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,1,1689837049358.151c29dd29443231c3428e1d11842a2b.' region-info for snapshot=snaptb0-testExportFileSystemState 2023-07-20 07:10:51,037 DEBUG [rs(jenkins-hbase4.apache.org,45099,1689837020733)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-20 07:10:51,037 DEBUG [rs(jenkins-hbase4.apache.org,45099,1689837020733)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/data/default/testtb-testExportFileSystemState/151c29dd29443231c3428e1d11842a2b/cf/0deb929f82464676864f9e0ac1f73cd3] hfiles 2023-07-20 07:10:51,037 DEBUG [rs(jenkins-hbase4.apache.org,45099,1689837020733)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/data/default/testtb-testExportFileSystemState/151c29dd29443231c3428e1d11842a2b/cf/0deb929f82464676864f9e0ac1f73cd3 for snapshot=snaptb0-testExportFileSystemState 2023-07-20 07:10:51,048 DEBUG [rs(jenkins-hbase4.apache.org,44955,1689837020792)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,,1689837049358.21bd4c362a1ad0a15a803722233575a3. completed. 2023-07-20 07:10:51,049 DEBUG [rs(jenkins-hbase4.apache.org,44955,1689837020792)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,,1689837049358.21bd4c362a1ad0a15a803722233575a3. 2023-07-20 07:10:51,049 DEBUG [member: 'jenkins-hbase4.apache.org,44955,1689837020792' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-20 07:10:51,049 DEBUG [member: 'jenkins-hbase4.apache.org,44955,1689837020792' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-20 07:10:51,049 DEBUG [member: 'jenkins-hbase4.apache.org,44955,1689837020792' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,44955,1689837020792 2023-07-20 07:10:51,049 DEBUG [member: 'jenkins-hbase4.apache.org,44955,1689837020792' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-07-20 07:10:51,049 DEBUG [member: 'jenkins-hbase4.apache.org,44955,1689837020792' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,44955,1689837020792' in zk 2023-07-20 07:10:51,051 DEBUG [rs(jenkins-hbase4.apache.org,45099,1689837020733)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,1,1689837049358.151c29dd29443231c3428e1d11842a2b. completed. 2023-07-20 07:10:51,051 DEBUG [rs(jenkins-hbase4.apache.org,45099,1689837020733)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,1,1689837049358.151c29dd29443231c3428e1d11842a2b. 2023-07-20 07:10:51,051 DEBUG [member: 'jenkins-hbase4.apache.org,45099,1689837020733' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-20 07:10:51,051 DEBUG [member: 'jenkins-hbase4.apache.org,45099,1689837020733' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-20 07:10:51,051 DEBUG [member: 'jenkins-hbase4.apache.org,45099,1689837020733' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,45099,1689837020733 2023-07-20 07:10:51,051 DEBUG [member: 'jenkins-hbase4.apache.org,45099,1689837020733' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-07-20 07:10:51,051 DEBUG [member: 'jenkins-hbase4.apache.org,45099,1689837020733' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,45099,1689837020733' in zk 2023-07-20 07:10:51,055 DEBUG [member: 'jenkins-hbase4.apache.org,44955,1689837020792' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-07-20 07:10:51,055 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): master:37415-0x10181911f0f0000, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,44955,1689837020792 2023-07-20 07:10:51,055 DEBUG [member: 'jenkins-hbase4.apache.org,44955,1689837020792' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-20 07:10:51,055 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,44955,1689837020792 2023-07-20 07:10:51,055 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-20 07:10:51,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-20 07:10:51,055 DEBUG [member: 'jenkins-hbase4.apache.org,44955,1689837020792' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-07-20 07:10:51,057 DEBUG [member: 'jenkins-hbase4.apache.org,45099,1689837020733' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-07-20 07:10:51,057 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): master:37415-0x10181911f0f0000, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45099,1689837020733 2023-07-20 07:10:51,057 DEBUG [member: 'jenkins-hbase4.apache.org,45099,1689837020733' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-20 07:10:51,057 DEBUG [member: 'jenkins-hbase4.apache.org,45099,1689837020733' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-07-20 07:10:51,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-20 07:10:51,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-20 07:10:51,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-20 07:10:51,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44955,1689837020792 2023-07-20 07:10:51,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44777,1689837020621 2023-07-20 07:10:51,061 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45099,1689837020733 2023-07-20 07:10:51,061 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-20 07:10:51,061 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-20 07:10:51,061 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44955,1689837020792 2023-07-20 07:10:51,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44777,1689837020621 2023-07-20 07:10:51,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45099,1689837020733 2023-07-20 07:10:51,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,44955,1689837020792': 2023-07-20 07:10:51,062 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44955,1689837020792' released barrier for procedure'snaptb0-testExportFileSystemState', counting down latch. Waiting for 1 more 2023-07-20 07:10:51,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45099,1689837020733 2023-07-20 07:10:51,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-20 07:10:51,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-20 07:10:51,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-20 07:10:51,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-20 07:10:51,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-20 07:10:51,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44955,1689837020792 2023-07-20 07:10:51,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44777,1689837020621 2023-07-20 07:10:51,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45099,1689837020733 2023-07-20 07:10:51,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-20 07:10:51,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-20 07:10:51,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44955,1689837020792 2023-07-20 07:10:51,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44777,1689837020621 2023-07-20 07:10:51,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45099,1689837020733 2023-07-20 07:10:51,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,45099,1689837020733': 2023-07-20 07:10:51,066 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,45099,1689837020733' released barrier for procedure'snaptb0-testExportFileSystemState', counting down latch. Waiting for 0 more 2023-07-20 07:10:51,066 INFO [(jenkins-hbase4.apache.org,37415,1689837019114)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemState' execution completed 2023-07-20 07:10:51,066 DEBUG [(jenkins-hbase4.apache.org,37415,1689837019114)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-20 07:10:51,066 DEBUG [(jenkins-hbase4.apache.org,37415,1689837019114)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-20 07:10:51,066 DEBUG [(jenkins-hbase4.apache.org,37415,1689837019114)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemState 2023-07-20 07:10:51,066 INFO [(jenkins-hbase4.apache.org,37415,1689837019114)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-20 07:10:51,068 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): regionserver:44777-0x10181911f0f0001, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-20 07:10:51,068 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): regionserver:44955-0x10181911f0f0003, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-20 07:10:51,068 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): regionserver:44777-0x10181911f0f0001, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 07:10:51,068 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): regionserver:44955-0x10181911f0f0003, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 07:10:51,068 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): master:37415-0x10181911f0f0000, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-20 07:10:51,068 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): regionserver:45099-0x10181911f0f0002, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-20 07:10:51,068 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-20 07:10:51,068 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-20 07:10:51,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-20 07:10:51,068 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-20 07:10:51,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-20 07:10:51,068 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): regionserver:45099-0x10181911f0f0002, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 07:10:51,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-20 07:10:51,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-20 07:10:51,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-20 07:10:51,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-20 07:10:51,069 DEBUG [(jenkins-hbase4.apache.org,37415,1689837019114)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37415-0x10181911f0f0000, quorum=127.0.0.1:58010, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,44955,1689837020792 2023-07-20 07:10:51,069 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 07:10:51,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 07:10:51,069 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 07:10:51,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 07:10:51,069 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 07:10:51,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 07:10:51,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-20 07:10:51,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-20 07:10:51,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-20 07:10:51,069 DEBUG [(jenkins-hbase4.apache.org,37415,1689837019114)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37415-0x10181911f0f0000, quorum=127.0.0.1:58010, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,44777,1689837020621 2023-07-20 07:10:51,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-20 07:10:51,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-20 07:10:51,070 DEBUG [(jenkins-hbase4.apache.org,37415,1689837019114)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37415-0x10181911f0f0000, quorum=127.0.0.1:58010, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45099,1689837020733 2023-07-20 07:10:51,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-20 07:10:51,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-20 07:10:51,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44955,1689837020792 2023-07-20 07:10:51,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44777,1689837020621 2023-07-20 07:10:51,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45099,1689837020733 2023-07-20 07:10:51,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-20 07:10:51,072 DEBUG [(jenkins-hbase4.apache.org,37415,1689837019114)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37415-0x10181911f0f0000, quorum=127.0.0.1:58010, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,44955,1689837020792 2023-07-20 07:10:51,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-20 07:10:51,072 DEBUG [(jenkins-hbase4.apache.org,37415,1689837019114)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37415-0x10181911f0f0000, quorum=127.0.0.1:58010, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,44777,1689837020621 2023-07-20 07:10:51,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44955,1689837020792 2023-07-20 07:10:51,072 DEBUG [(jenkins-hbase4.apache.org,37415,1689837019114)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37415-0x10181911f0f0000, quorum=127.0.0.1:58010, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45099,1689837020733 2023-07-20 07:10:51,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44777,1689837020621 2023-07-20 07:10:51,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45099,1689837020733 2023-07-20 07:10:51,075 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): master:37415-0x10181911f0f0000, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45099,1689837020733 2023-07-20 07:10:51,075 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): master:37415-0x10181911f0f0000, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-20 07:10:51,075 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): master:37415-0x10181911f0f0000, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,44777,1689837020621 2023-07-20 07:10:51,075 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): master:37415-0x10181911f0f0000, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,44955,1689837020792 2023-07-20 07:10:51,075 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): regionserver:44777-0x10181911f0f0001, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 07:10:51,075 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): regionserver:44955-0x10181911f0f0003, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 07:10:51,076 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 07:10:51,076 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 07:10:51,076 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): regionserver:45099-0x10181911f0f0002, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 07:10:51,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 07:10:51,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 07:10:51,076 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): regionserver:44955-0x10181911f0f0003, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 07:10:51,076 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemState 2023-07-20 07:10:51,076 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): regionserver:44777-0x10181911f0f0001, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 07:10:51,075 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): master:37415-0x10181911f0f0000, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-20 07:10:51,076 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemState 2023-07-20 07:10:51,076 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 07:10:51,076 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 07:10:51,076 DEBUG [(jenkins-hbase4.apache.org,37415,1689837019114)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-20 07:10:51,076 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 07:10:51,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 07:10:51,076 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): regionserver:45099-0x10181911f0f0002, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 07:10:51,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 07:10:51,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 07:10:51,076 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 8c2558c0b59bb3a4e2e578c2c8e8915d, NAME => 'testtb-testExportFileSystemState,.mob,0.8c2558c0b59bb3a4e2e578c2c8e8915d.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportFileSystemState 2023-07-20 07:10:51,076 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): master:37415-0x10181911f0f0000, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45099,1689837020733 2023-07-20 07:10:51,079 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 07:10:51,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 07:10:51,079 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): master:37415-0x10181911f0f0000, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-20 07:10:51,078 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-20 07:10:51,079 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): master:37415-0x10181911f0f0000, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,44777,1689837020621 2023-07-20 07:10:51,079 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): master:37415-0x10181911f0f0000, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,44955,1689837020792 2023-07-20 07:10:51,079 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): master:37415-0x10181911f0f0000, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-20 07:10:51,079 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): master:37415-0x10181911f0f0000, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-20 07:10:51,080 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b20230720eb748dd401c048e3b4f112c9a33ec414, hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e20230720a60279b0e9d34f42a3e5f2bc554a14be] mob files 2023-07-20 07:10:51,080 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b20230720eb748dd401c048e3b4f112c9a33ec414 2023-07-20 07:10:51,080 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e20230720a60279b0e9d34f42a3e5f2bc554a14be 2023-07-20 07:10:51,090 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemState 2023-07-20 07:10:51,091 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-20 07:10:51,120 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState to hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-07-20 07:10:51,154 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed 2023-07-20 07:10:51,154 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-20 07:10:51,155 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-20 07:10:51,155 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState at 1689837050925Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemState at 1689837051090 (+165 ms)Consolidate snapshot: snaptb0-testExportFileSystemState at 1689837051090Loading Region manifests for snaptb0-testExportFileSystemState at 1689837051090Writing data manifest for snaptb0-testExportFileSystemState at 1689837051094 (+4 ms)Verifying snapshot: snaptb0-testExportFileSystemState at 1689837051111 (+17 ms)Snapshot snaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed at 1689837051154 (+43 ms) 2023-07-20 07:10:51,158 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=35, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-20 07:10:51,161 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=35, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED in 231 msec 2023-07-20 07:10:51,229 DEBUG [Listener at jenkins-hbase4.apache.org/33837] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-20 07:10:51,230 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-20 07:10:51,231 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-20 07:10:51,231 INFO [Listener at jenkins-hbase4.apache.org/33837] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/export-test/export-1689837051231 2023-07-20 07:10:51,231 INFO [Listener at jenkins-hbase4.apache.org/33837] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:39649, tgtDir=hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/export-test/export-1689837051231, rawTgtDir=hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/export-test/export-1689837051231, srcFsUri=hdfs://localhost:39649, srcDir=hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b 2023-07-20 07:10:51,259 DEBUG [Listener at jenkins-hbase4.apache.org/33837] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:39649, inputRoot=hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b 2023-07-20 07:10:51,259 DEBUG [Listener at jenkins-hbase4.apache.org/33837] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-509184279_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/export-test/export-1689837051231, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/export-test/export-1689837051231/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-20 07:10:51,259 INFO [Listener at jenkins-hbase4.apache.org/33837] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:39649, inputRoot=hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b, snapshotDir=hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/.hbase-snapshot/snaptb0-testExportFileSystemState. 2023-07-20 07:10:51,283 INFO [Listener at jenkins-hbase4.apache.org/33837] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/.hbase-snapshot/snaptb0-testExportFileSystemState to hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/export-test/export-1689837051231/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-20 07:10:51,315 DEBUG [Listener at jenkins-hbase4.apache.org/33837] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-20 07:10:51,316 DEBUG [Listener at jenkins-hbase4.apache.org/33837] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-20 07:10:51,316 DEBUG [Listener at jenkins-hbase4.apache.org/33837] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-20 07:10:51,317 DEBUG [Listener at jenkins-hbase4.apache.org/33837] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-20 07:10:51,317 DEBUG [Listener at jenkins-hbase4.apache.org/33837] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-20 07:10:51,317 DEBUG [Listener at jenkins-hbase4.apache.org/33837] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-20 07:10:51,317 DEBUG [Listener at jenkins-hbase4.apache.org/33837] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-20 07:10:51,388 DEBUG [Listener at jenkins-hbase4.apache.org/33837] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c07d5e8c-eba2-0ae8-aa3a-b7afa648e7e7/hadoop-1890118995570769084.jar 2023-07-20 07:10:51,388 DEBUG [Listener at jenkins-hbase4.apache.org/33837] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-20 07:10:51,389 DEBUG [Listener at jenkins-hbase4.apache.org/33837] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-20 07:10:51,389 DEBUG [Listener at jenkins-hbase4.apache.org/33837] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-20 07:10:51,389 DEBUG [Listener at jenkins-hbase4.apache.org/33837] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-20 07:10:51,390 DEBUG [Listener at jenkins-hbase4.apache.org/33837] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-20 07:10:51,390 DEBUG [Listener at jenkins-hbase4.apache.org/33837] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-20 07:10:51,391 DEBUG [Listener at jenkins-hbase4.apache.org/33837] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-20 07:10:51,391 DEBUG [Listener at jenkins-hbase4.apache.org/33837] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-20 07:10:51,391 DEBUG [Listener at jenkins-hbase4.apache.org/33837] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-20 07:10:51,392 DEBUG [Listener at jenkins-hbase4.apache.org/33837] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-20 07:10:51,392 DEBUG [Listener at jenkins-hbase4.apache.org/33837] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-20 07:10:51,393 DEBUG [Listener at jenkins-hbase4.apache.org/33837] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-20 07:10:51,393 DEBUG [Listener at jenkins-hbase4.apache.org/33837] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-20 07:10:51,394 DEBUG [Listener at jenkins-hbase4.apache.org/33837] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-20 07:10:51,394 DEBUG [Listener at jenkins-hbase4.apache.org/33837] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-20 07:10:51,394 DEBUG [Listener at jenkins-hbase4.apache.org/33837] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-20 07:10:51,395 DEBUG [Listener at jenkins-hbase4.apache.org/33837] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-20 07:10:51,395 DEBUG [Listener at jenkins-hbase4.apache.org/33837] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-20 07:10:51,396 DEBUG [Listener at jenkins-hbase4.apache.org/33837] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-20 07:10:51,396 DEBUG [Listener at jenkins-hbase4.apache.org/33837] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-20 07:10:51,396 DEBUG [Listener at jenkins-hbase4.apache.org/33837] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-20 07:10:51,396 DEBUG [Listener at jenkins-hbase4.apache.org/33837] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-20 07:10:51,397 DEBUG [Listener at jenkins-hbase4.apache.org/33837] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-20 07:10:51,885 WARN [Listener at jenkins-hbase4.apache.org/33837] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-20 07:10:51,889 INFO [Listener at jenkins-hbase4.apache.org/33837] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemState' hfile list 2023-07-20 07:10:51,893 DEBUG [Listener at jenkins-hbase4.apache.org/33837] snapshot.ExportSnapshot(671): export split=0 size=30.9 K 2023-07-20 07:10:53,715 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-20 07:10:53,715 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-20 07:10:53,722 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689837028633_0001_000001 (auth:SIMPLE) 2023-07-20 07:10:54,212 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689837028633_0002_000001 (auth:SIMPLE) 2023-07-20 07:10:54,588 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-20 07:10:59,485 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689837028633_0002_000001 (auth:SIMPLE) 2023-07-20 07:11:01,745 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689837028633_0002_000001 (auth:SIMPLE) 2023-07-20 07:11:07,169 INFO [Listener at jenkins-hbase4.apache.org/33837] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-20 07:11:07,173 INFO [Listener at jenkins-hbase4.apache.org/33837] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-20 07:11:07,190 INFO [Listener at jenkins-hbase4.apache.org/33837] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemState 2023-07-20 07:11:07,190 INFO [Listener at jenkins-hbase4.apache.org/33837] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-20 07:11:07,191 INFO [Listener at jenkins-hbase4.apache.org/33837] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-20 07:11:07,191 DEBUG [Listener at jenkins-hbase4.apache.org/33837] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_759529442_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/.hbase-snapshot/snaptb0-testExportFileSystemState at hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-07-20 07:11:07,194 DEBUG [Listener at jenkins-hbase4.apache.org/33837] snapshot.TestExportSnapshot(367): hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/.hbase-snapshot/snaptb0-testExportFileSystemState/.snapshotinfo 2023-07-20 07:11:07,194 DEBUG [Listener at jenkins-hbase4.apache.org/33837] snapshot.TestExportSnapshot(367): hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/.hbase-snapshot/snaptb0-testExportFileSystemState/data.manifest 2023-07-20 07:11:07,194 DEBUG [Listener at jenkins-hbase4.apache.org/33837] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_759529442_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/export-test/export-1689837051231/.hbase-snapshot/snaptb0-testExportFileSystemState at hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/export-test/export-1689837051231/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-07-20 07:11:07,195 DEBUG [Listener at jenkins-hbase4.apache.org/33837] snapshot.TestExportSnapshot(367): hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/export-test/export-1689837051231/.hbase-snapshot/snaptb0-testExportFileSystemState/.snapshotinfo 2023-07-20 07:11:07,195 DEBUG [Listener at jenkins-hbase4.apache.org/33837] snapshot.TestExportSnapshot(367): hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/export-test/export-1689837051231/.hbase-snapshot/snaptb0-testExportFileSystemState/data.manifest 2023-07-20 07:11:07,211 INFO [Listener at jenkins-hbase4.apache.org/33837] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemState 2023-07-20 07:11:07,212 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemState 2023-07-20 07:11:07,213 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] procedure2.ProcedureExecutor(1029): Stored pid=36, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemState 2023-07-20 07:11:07,221 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-07-20 07:11:07,222 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689837067222"}]},"ts":"1689837067222"} 2023-07-20 07:11:07,224 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=DISABLING in hbase:meta 2023-07-20 07:11:07,228 INFO [PEWorker-5] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemState to state=DISABLING 2023-07-20 07:11:07,229 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=37, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=21bd4c362a1ad0a15a803722233575a3, UNASSIGN}, {pid=38, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=151c29dd29443231c3428e1d11842a2b, UNASSIGN}] 2023-07-20 07:11:07,232 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=37, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=21bd4c362a1ad0a15a803722233575a3, UNASSIGN 2023-07-20 07:11:07,232 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=38, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=151c29dd29443231c3428e1d11842a2b, UNASSIGN 2023-07-20 07:11:07,233 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=21bd4c362a1ad0a15a803722233575a3, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,44955,1689837020792 2023-07-20 07:11:07,233 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=151c29dd29443231c3428e1d11842a2b, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,45099,1689837020733 2023-07-20 07:11:07,233 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,,1689837049358.21bd4c362a1ad0a15a803722233575a3.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689837067233"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689837067233"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689837067233"}]},"ts":"1689837067233"} 2023-07-20 07:11:07,233 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,1,1689837049358.151c29dd29443231c3428e1d11842a2b.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689837067233"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689837067233"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689837067233"}]},"ts":"1689837067233"} 2023-07-20 07:11:07,235 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=39, ppid=37, state=RUNNABLE; CloseRegionProcedure 21bd4c362a1ad0a15a803722233575a3, server=jenkins-hbase4.apache.org,44955,1689837020792}] 2023-07-20 07:11:07,236 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=40, ppid=38, state=RUNNABLE; CloseRegionProcedure 151c29dd29443231c3428e1d11842a2b, server=jenkins-hbase4.apache.org,45099,1689837020733}] 2023-07-20 07:11:07,323 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-07-20 07:11:07,388 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 21bd4c362a1ad0a15a803722233575a3 2023-07-20 07:11:07,388 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 21bd4c362a1ad0a15a803722233575a3, disabling compactions & flushes 2023-07-20 07:11:07,388 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,,1689837049358.21bd4c362a1ad0a15a803722233575a3. 2023-07-20 07:11:07,388 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,,1689837049358.21bd4c362a1ad0a15a803722233575a3. 2023-07-20 07:11:07,388 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,,1689837049358.21bd4c362a1ad0a15a803722233575a3. after waiting 0 ms 2023-07-20 07:11:07,388 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,,1689837049358.21bd4c362a1ad0a15a803722233575a3. 2023-07-20 07:11:07,389 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 151c29dd29443231c3428e1d11842a2b 2023-07-20 07:11:07,392 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 151c29dd29443231c3428e1d11842a2b, disabling compactions & flushes 2023-07-20 07:11:07,392 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,1,1689837049358.151c29dd29443231c3428e1d11842a2b. 2023-07-20 07:11:07,393 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,1,1689837049358.151c29dd29443231c3428e1d11842a2b. 2023-07-20 07:11:07,393 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,1,1689837049358.151c29dd29443231c3428e1d11842a2b. after waiting 0 ms 2023-07-20 07:11:07,393 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,1,1689837049358.151c29dd29443231c3428e1d11842a2b. 2023-07-20 07:11:07,406 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/data/default/testtb-testExportFileSystemState/21bd4c362a1ad0a15a803722233575a3/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-20 07:11:07,406 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/data/default/testtb-testExportFileSystemState/151c29dd29443231c3428e1d11842a2b/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-20 07:11:07,406 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-20 07:11:07,406 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-20 07:11:07,408 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,,1689837049358.21bd4c362a1ad0a15a803722233575a3. 2023-07-20 07:11:07,408 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,1,1689837049358.151c29dd29443231c3428e1d11842a2b. 2023-07-20 07:11:07,408 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 21bd4c362a1ad0a15a803722233575a3: 2023-07-20 07:11:07,408 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 151c29dd29443231c3428e1d11842a2b: 2023-07-20 07:11:07,410 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 21bd4c362a1ad0a15a803722233575a3 2023-07-20 07:11:07,411 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=21bd4c362a1ad0a15a803722233575a3, regionState=CLOSED 2023-07-20 07:11:07,411 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,,1689837049358.21bd4c362a1ad0a15a803722233575a3.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689837067411"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689837067411"}]},"ts":"1689837067411"} 2023-07-20 07:11:07,411 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 151c29dd29443231c3428e1d11842a2b 2023-07-20 07:11:07,412 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=151c29dd29443231c3428e1d11842a2b, regionState=CLOSED 2023-07-20 07:11:07,412 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,1,1689837049358.151c29dd29443231c3428e1d11842a2b.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689837067412"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689837067412"}]},"ts":"1689837067412"} 2023-07-20 07:11:07,415 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=39, resume processing ppid=37 2023-07-20 07:11:07,415 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=39, ppid=37, state=SUCCESS; CloseRegionProcedure 21bd4c362a1ad0a15a803722233575a3, server=jenkins-hbase4.apache.org,44955,1689837020792 in 178 msec 2023-07-20 07:11:07,416 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=40, resume processing ppid=38 2023-07-20 07:11:07,416 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=40, ppid=38, state=SUCCESS; CloseRegionProcedure 151c29dd29443231c3428e1d11842a2b, server=jenkins-hbase4.apache.org,45099,1689837020733 in 178 msec 2023-07-20 07:11:07,417 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=37, ppid=36, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=21bd4c362a1ad0a15a803722233575a3, UNASSIGN in 186 msec 2023-07-20 07:11:07,419 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=38, resume processing ppid=36 2023-07-20 07:11:07,419 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=38, ppid=36, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=151c29dd29443231c3428e1d11842a2b, UNASSIGN in 187 msec 2023-07-20 07:11:07,420 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689837067420"}]},"ts":"1689837067420"} 2023-07-20 07:11:07,424 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=DISABLED in hbase:meta 2023-07-20 07:11:07,426 INFO [PEWorker-4] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemState to state=DISABLED 2023-07-20 07:11:07,430 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=36, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemState in 215 msec 2023-07-20 07:11:07,524 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-07-20 07:11:07,525 INFO [Listener at jenkins-hbase4.apache.org/33837] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemState, procId: 36 completed 2023-07-20 07:11:07,526 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemState 2023-07-20 07:11:07,528 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] procedure2.ProcedureExecutor(1029): Stored pid=41, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-20 07:11:07,531 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=41, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-20 07:11:07,531 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemState 2023-07-20 07:11:07,533 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=41, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-20 07:11:07,534 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=44955] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemState 2023-07-20 07:11:07,537 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): master:37415-0x10181911f0f0000, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-20 07:11:07,537 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): regionserver:44777-0x10181911f0f0001, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-20 07:11:07,537 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): regionserver:45099-0x10181911f0f0002, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-20 07:11:07,537 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): regionserver:44955-0x10181911f0f0003, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-20 07:11:07,538 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-07-20 07:11:07,538 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-07-20 07:11:07,538 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-07-20 07:11:07,538 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-07-20 07:11:07,539 DEBUG [HFileArchiver-9] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/.tmp/data/default/testtb-testExportFileSystemState/21bd4c362a1ad0a15a803722233575a3 2023-07-20 07:11:07,539 DEBUG [HFileArchiver-10] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/.tmp/data/default/testtb-testExportFileSystemState/151c29dd29443231c3428e1d11842a2b 2023-07-20 07:11:07,540 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): master:37415-0x10181911f0f0000, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-20 07:11:07,540 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): master:37415-0x10181911f0f0000, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-20 07:11:07,541 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): regionserver:45099-0x10181911f0f0002, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-20 07:11:07,541 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): regionserver:45099-0x10181911f0f0002, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-20 07:11:07,541 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): regionserver:44777-0x10181911f0f0001, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-20 07:11:07,541 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): regionserver:44955-0x10181911f0f0003, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-20 07:11:07,541 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): regionserver:44777-0x10181911f0f0001, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-20 07:11:07,541 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): regionserver:44955-0x10181911f0f0003, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-20 07:11:07,542 DEBUG [HFileArchiver-10] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/.tmp/data/default/testtb-testExportFileSystemState/151c29dd29443231c3428e1d11842a2b/cf, FileablePath, hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/.tmp/data/default/testtb-testExportFileSystemState/151c29dd29443231c3428e1d11842a2b/recovered.edits] 2023-07-20 07:11:07,542 DEBUG [HFileArchiver-9] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/.tmp/data/default/testtb-testExportFileSystemState/21bd4c362a1ad0a15a803722233575a3/cf, FileablePath, hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/.tmp/data/default/testtb-testExportFileSystemState/21bd4c362a1ad0a15a803722233575a3/recovered.edits] 2023-07-20 07:11:07,542 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] master.MasterRpcServices(1230): Checking to see if procedure is done pid=41 2023-07-20 07:11:07,547 DEBUG [HFileArchiver-10] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/.tmp/data/default/testtb-testExportFileSystemState/151c29dd29443231c3428e1d11842a2b/cf/0deb929f82464676864f9e0ac1f73cd3 to hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/archive/data/default/testtb-testExportFileSystemState/151c29dd29443231c3428e1d11842a2b/cf/0deb929f82464676864f9e0ac1f73cd3 2023-07-20 07:11:07,547 DEBUG [HFileArchiver-9] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/.tmp/data/default/testtb-testExportFileSystemState/21bd4c362a1ad0a15a803722233575a3/cf/cb4ab35dc8cc4d2da85a968d45ca174f to hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/archive/data/default/testtb-testExportFileSystemState/21bd4c362a1ad0a15a803722233575a3/cf/cb4ab35dc8cc4d2da85a968d45ca174f 2023-07-20 07:11:07,551 DEBUG [HFileArchiver-10] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/.tmp/data/default/testtb-testExportFileSystemState/151c29dd29443231c3428e1d11842a2b/recovered.edits/9.seqid to hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/archive/data/default/testtb-testExportFileSystemState/151c29dd29443231c3428e1d11842a2b/recovered.edits/9.seqid 2023-07-20 07:11:07,552 DEBUG [HFileArchiver-9] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/.tmp/data/default/testtb-testExportFileSystemState/21bd4c362a1ad0a15a803722233575a3/recovered.edits/9.seqid to hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/archive/data/default/testtb-testExportFileSystemState/21bd4c362a1ad0a15a803722233575a3/recovered.edits/9.seqid 2023-07-20 07:11:07,552 DEBUG [HFileArchiver-10] backup.HFileArchiver(596): Deleted hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/.tmp/data/default/testtb-testExportFileSystemState/151c29dd29443231c3428e1d11842a2b 2023-07-20 07:11:07,553 DEBUG [HFileArchiver-9] backup.HFileArchiver(596): Deleted hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/.tmp/data/default/testtb-testExportFileSystemState/21bd4c362a1ad0a15a803722233575a3 2023-07-20 07:11:07,553 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemState regions 2023-07-20 07:11:07,554 DEBUG [PEWorker-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d 2023-07-20 07:11:07,555 DEBUG [PEWorker-1] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf] 2023-07-20 07:11:07,559 DEBUG [PEWorker-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b20230720eb748dd401c048e3b4f112c9a33ec414 to hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/archive/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b20230720eb748dd401c048e3b4f112c9a33ec414 2023-07-20 07:11:07,561 DEBUG [PEWorker-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e20230720a60279b0e9d34f42a3e5f2bc554a14be to hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/archive/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e20230720a60279b0e9d34f42a3e5f2bc554a14be 2023-07-20 07:11:07,561 DEBUG [PEWorker-1] backup.HFileArchiver(596): Deleted hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d 2023-07-20 07:11:07,564 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=41, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-20 07:11:07,569 WARN [PEWorker-1] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemState from hbase:meta 2023-07-20 07:11:07,572 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemState' descriptor. 2023-07-20 07:11:07,574 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=41, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-20 07:11:07,574 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemState' from region states. 2023-07-20 07:11:07,574 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState,,1689837049358.21bd4c362a1ad0a15a803722233575a3.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689837067574"}]},"ts":"9223372036854775807"} 2023-07-20 07:11:07,574 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState,1,1689837049358.151c29dd29443231c3428e1d11842a2b.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689837067574"}]},"ts":"9223372036854775807"} 2023-07-20 07:11:07,581 INFO [PEWorker-1] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-20 07:11:07,581 DEBUG [PEWorker-1] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 21bd4c362a1ad0a15a803722233575a3, NAME => 'testtb-testExportFileSystemState,,1689837049358.21bd4c362a1ad0a15a803722233575a3.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 151c29dd29443231c3428e1d11842a2b, NAME => 'testtb-testExportFileSystemState,1,1689837049358.151c29dd29443231c3428e1d11842a2b.', STARTKEY => '1', ENDKEY => ''}] 2023-07-20 07:11:07,581 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemState' as deleted. 2023-07-20 07:11:07,581 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689837067581"}]},"ts":"9223372036854775807"} 2023-07-20 07:11:07,583 INFO [PEWorker-1] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemState state from META 2023-07-20 07:11:07,586 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(130): Finished pid=41, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-20 07:11:07,589 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=41, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemState in 60 msec 2023-07-20 07:11:07,644 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] master.MasterRpcServices(1230): Checking to see if procedure is done pid=41 2023-07-20 07:11:07,644 INFO [Listener at jenkins-hbase4.apache.org/33837] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemState, procId: 41 completed 2023-07-20 07:11:07,652 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportFileSystemState" 2023-07-20 07:11:07,654 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemState 2023-07-20 07:11:07,656 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemState" 2023-07-20 07:11:07,657 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemState 2023-07-20 07:11:07,684 INFO [Listener at jenkins-hbase4.apache.org/33837] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportFileSystemState Thread=764 (was 753) Potentially hanging thread: HFileArchiver-7 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_759529442_17 at /127.0.0.1:55046 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LogDeleter #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-8 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x7a39bf3a-shared-pool-15 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x7a39bf3a-shared-pool-18 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_118779332_1 at /127.0.0.1:44754 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-2030 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: IPC Client (309353702) connection to jenkins-hbase4.apache.org/172.31.14.131:34489 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: HFileArchiver-10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (309353702) connection to jenkins-hbase4.apache.org/172.31.14.131:32853 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_759529442_17 at /127.0.0.1:37508 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x7a39bf3a-shared-pool-16 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x7a39bf3a-shared-pool-17 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_759529442_17 at /127.0.0.1:44778 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_118779332_1 at /127.0.0.1:37494 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=937 (was 922) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=330 (was 381), ProcessCount=183 (was 183), AvailableMemoryMB=2706 (was 2851) 2023-07-20 07:11:07,685 WARN [Listener at jenkins-hbase4.apache.org/33837] hbase.ResourceChecker(130): Thread=764 is superior to 500 2023-07-20 07:11:07,710 INFO [Listener at jenkins-hbase4.apache.org/33837] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testConsecutiveExports Thread=764, OpenFileDescriptor=937, MaxFileDescriptor=60000, SystemLoadAverage=330, ProcessCount=183, AvailableMemoryMB=2705 2023-07-20 07:11:07,710 WARN [Listener at jenkins-hbase4.apache.org/33837] hbase.ResourceChecker(130): Thread=764 is superior to 500 2023-07-20 07:11:07,712 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-07-20 07:11:07,713 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] procedure2.ProcedureExecutor(1029): Stored pid=42, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testConsecutiveExports 2023-07-20 07:11:07,716 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_PRE_OPERATION 2023-07-20 07:11:07,716 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testConsecutiveExports" procId is: 42 2023-07-20 07:11:07,717 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-20 07:11:07,717 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-20 07:11:07,719 DEBUG [HFileArchiver-11] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/.tmp/data/default/testtb-testConsecutiveExports/52751ad62937af1c337cf2fca6ca3172 2023-07-20 07:11:07,719 DEBUG [HFileArchiver-12] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/.tmp/data/default/testtb-testConsecutiveExports/9d899a3184674b1fdb7c9328824d7572 2023-07-20 07:11:07,720 DEBUG [HFileArchiver-11] backup.HFileArchiver(153): Directory hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/.tmp/data/default/testtb-testConsecutiveExports/52751ad62937af1c337cf2fca6ca3172 empty. 2023-07-20 07:11:07,720 DEBUG [HFileArchiver-12] backup.HFileArchiver(153): Directory hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/.tmp/data/default/testtb-testConsecutiveExports/9d899a3184674b1fdb7c9328824d7572 empty. 2023-07-20 07:11:07,720 DEBUG [HFileArchiver-11] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/.tmp/data/default/testtb-testConsecutiveExports/52751ad62937af1c337cf2fca6ca3172 2023-07-20 07:11:07,720 DEBUG [HFileArchiver-12] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/.tmp/data/default/testtb-testConsecutiveExports/9d899a3184674b1fdb7c9328824d7572 2023-07-20 07:11:07,720 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testConsecutiveExports regions 2023-07-20 07:11:07,736 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/.tmp/data/default/testtb-testConsecutiveExports/.tabledesc/.tableinfo.0000000001 2023-07-20 07:11:07,737 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(7675): creating {ENCODED => 52751ad62937af1c337cf2fca6ca3172, NAME => 'testtb-testConsecutiveExports,,1689837067711.52751ad62937af1c337cf2fca6ca3172.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/.tmp 2023-07-20 07:11:07,738 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(7675): creating {ENCODED => 9d899a3184674b1fdb7c9328824d7572, NAME => 'testtb-testConsecutiveExports,1,1689837067711.9d899a3184674b1fdb7c9328824d7572.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/.tmp 2023-07-20 07:11:07,768 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,,1689837067711.52751ad62937af1c337cf2fca6ca3172.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-20 07:11:07,769 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,1,1689837067711.9d899a3184674b1fdb7c9328824d7572.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-20 07:11:07,769 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1604): Closing 52751ad62937af1c337cf2fca6ca3172, disabling compactions & flushes 2023-07-20 07:11:07,769 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1604): Closing 9d899a3184674b1fdb7c9328824d7572, disabling compactions & flushes 2023-07-20 07:11:07,769 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,,1689837067711.52751ad62937af1c337cf2fca6ca3172. 2023-07-20 07:11:07,769 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,,1689837067711.52751ad62937af1c337cf2fca6ca3172. 2023-07-20 07:11:07,769 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,1,1689837067711.9d899a3184674b1fdb7c9328824d7572. 2023-07-20 07:11:07,769 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,,1689837067711.52751ad62937af1c337cf2fca6ca3172. after waiting 0 ms 2023-07-20 07:11:07,769 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,,1689837067711.52751ad62937af1c337cf2fca6ca3172. 2023-07-20 07:11:07,769 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,1,1689837067711.9d899a3184674b1fdb7c9328824d7572. 2023-07-20 07:11:07,769 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,,1689837067711.52751ad62937af1c337cf2fca6ca3172. 2023-07-20 07:11:07,769 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,1,1689837067711.9d899a3184674b1fdb7c9328824d7572. after waiting 0 ms 2023-07-20 07:11:07,769 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1558): Region close journal for 52751ad62937af1c337cf2fca6ca3172: 2023-07-20 07:11:07,769 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,1,1689837067711.9d899a3184674b1fdb7c9328824d7572. 2023-07-20 07:11:07,769 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,1,1689837067711.9d899a3184674b1fdb7c9328824d7572. 2023-07-20 07:11:07,769 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1558): Region close journal for 9d899a3184674b1fdb7c9328824d7572: 2023-07-20 07:11:07,772 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_ADD_TO_META 2023-07-20 07:11:07,773 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,,1689837067711.52751ad62937af1c337cf2fca6ca3172.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689837067773"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689837067773"}]},"ts":"1689837067773"} 2023-07-20 07:11:07,773 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,1,1689837067711.9d899a3184674b1fdb7c9328824d7572.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689837067773"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689837067773"}]},"ts":"1689837067773"} 2023-07-20 07:11:07,776 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-20 07:11:07,777 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-20 07:11:07,777 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689837067777"}]},"ts":"1689837067777"} 2023-07-20 07:11:07,779 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=ENABLING in hbase:meta 2023-07-20 07:11:07,783 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-20 07:11:07,785 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-20 07:11:07,785 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-20 07:11:07,785 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-20 07:11:07,785 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-20 07:11:07,785 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=52751ad62937af1c337cf2fca6ca3172, ASSIGN}, {pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=9d899a3184674b1fdb7c9328824d7572, ASSIGN}] 2023-07-20 07:11:07,788 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=52751ad62937af1c337cf2fca6ca3172, ASSIGN 2023-07-20 07:11:07,788 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=9d899a3184674b1fdb7c9328824d7572, ASSIGN 2023-07-20 07:11:07,789 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=52751ad62937af1c337cf2fca6ca3172, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,44777,1689837020621; forceNewPlan=false, retain=false 2023-07-20 07:11:07,789 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=9d899a3184674b1fdb7c9328824d7572, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,44955,1689837020792; forceNewPlan=false, retain=false 2023-07-20 07:11:07,818 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-20 07:11:07,940 INFO [jenkins-hbase4:37415] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-20 07:11:07,943 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=52751ad62937af1c337cf2fca6ca3172, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,44777,1689837020621 2023-07-20 07:11:07,943 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=44 updating hbase:meta row=9d899a3184674b1fdb7c9328824d7572, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,44955,1689837020792 2023-07-20 07:11:07,944 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,,1689837067711.52751ad62937af1c337cf2fca6ca3172.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689837067943"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689837067943"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689837067943"}]},"ts":"1689837067943"} 2023-07-20 07:11:07,944 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,1,1689837067711.9d899a3184674b1fdb7c9328824d7572.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689837067943"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689837067943"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689837067943"}]},"ts":"1689837067943"} 2023-07-20 07:11:07,947 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=45, ppid=43, state=RUNNABLE; OpenRegionProcedure 52751ad62937af1c337cf2fca6ca3172, server=jenkins-hbase4.apache.org,44777,1689837020621}] 2023-07-20 07:11:07,948 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=46, ppid=44, state=RUNNABLE; OpenRegionProcedure 9d899a3184674b1fdb7c9328824d7572, server=jenkins-hbase4.apache.org,44955,1689837020792}] 2023-07-20 07:11:08,020 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-20 07:11:08,107 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testConsecutiveExports,1,1689837067711.9d899a3184674b1fdb7c9328824d7572. 2023-07-20 07:11:08,107 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testConsecutiveExports,,1689837067711.52751ad62937af1c337cf2fca6ca3172. 2023-07-20 07:11:08,107 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 9d899a3184674b1fdb7c9328824d7572, NAME => 'testtb-testConsecutiveExports,1,1689837067711.9d899a3184674b1fdb7c9328824d7572.', STARTKEY => '1', ENDKEY => ''} 2023-07-20 07:11:08,107 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 52751ad62937af1c337cf2fca6ca3172, NAME => 'testtb-testConsecutiveExports,,1689837067711.52751ad62937af1c337cf2fca6ca3172.', STARTKEY => '', ENDKEY => '1'} 2023-07-20 07:11:08,107 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testConsecutiveExports,1,1689837067711.9d899a3184674b1fdb7c9328824d7572. service=AccessControlService 2023-07-20 07:11:08,107 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testConsecutiveExports,,1689837067711.52751ad62937af1c337cf2fca6ca3172. service=AccessControlService 2023-07-20 07:11:08,107 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-20 07:11:08,107 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-20 07:11:08,108 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testConsecutiveExports 9d899a3184674b1fdb7c9328824d7572 2023-07-20 07:11:08,108 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testConsecutiveExports 52751ad62937af1c337cf2fca6ca3172 2023-07-20 07:11:08,108 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,1,1689837067711.9d899a3184674b1fdb7c9328824d7572.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-20 07:11:08,108 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,,1689837067711.52751ad62937af1c337cf2fca6ca3172.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-20 07:11:08,108 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 9d899a3184674b1fdb7c9328824d7572 2023-07-20 07:11:08,108 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 52751ad62937af1c337cf2fca6ca3172 2023-07-20 07:11:08,108 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 9d899a3184674b1fdb7c9328824d7572 2023-07-20 07:11:08,108 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 52751ad62937af1c337cf2fca6ca3172 2023-07-20 07:11:08,110 INFO [StoreOpener-9d899a3184674b1fdb7c9328824d7572-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 9d899a3184674b1fdb7c9328824d7572 2023-07-20 07:11:08,110 INFO [StoreOpener-52751ad62937af1c337cf2fca6ca3172-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 52751ad62937af1c337cf2fca6ca3172 2023-07-20 07:11:08,111 DEBUG [StoreOpener-9d899a3184674b1fdb7c9328824d7572-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/data/default/testtb-testConsecutiveExports/9d899a3184674b1fdb7c9328824d7572/cf 2023-07-20 07:11:08,111 DEBUG [StoreOpener-9d899a3184674b1fdb7c9328824d7572-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/data/default/testtb-testConsecutiveExports/9d899a3184674b1fdb7c9328824d7572/cf 2023-07-20 07:11:08,112 INFO [StoreOpener-9d899a3184674b1fdb7c9328824d7572-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 9d899a3184674b1fdb7c9328824d7572 columnFamilyName cf 2023-07-20 07:11:08,114 INFO [StoreOpener-9d899a3184674b1fdb7c9328824d7572-1] regionserver.HStore(310): Store=9d899a3184674b1fdb7c9328824d7572/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-20 07:11:08,115 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/data/default/testtb-testConsecutiveExports/9d899a3184674b1fdb7c9328824d7572 2023-07-20 07:11:08,115 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/data/default/testtb-testConsecutiveExports/9d899a3184674b1fdb7c9328824d7572 2023-07-20 07:11:08,116 DEBUG [StoreOpener-52751ad62937af1c337cf2fca6ca3172-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/data/default/testtb-testConsecutiveExports/52751ad62937af1c337cf2fca6ca3172/cf 2023-07-20 07:11:08,116 DEBUG [StoreOpener-52751ad62937af1c337cf2fca6ca3172-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/data/default/testtb-testConsecutiveExports/52751ad62937af1c337cf2fca6ca3172/cf 2023-07-20 07:11:08,117 INFO [StoreOpener-52751ad62937af1c337cf2fca6ca3172-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 52751ad62937af1c337cf2fca6ca3172 columnFamilyName cf 2023-07-20 07:11:08,118 INFO [StoreOpener-52751ad62937af1c337cf2fca6ca3172-1] regionserver.HStore(310): Store=52751ad62937af1c337cf2fca6ca3172/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-20 07:11:08,118 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 9d899a3184674b1fdb7c9328824d7572 2023-07-20 07:11:08,119 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/data/default/testtb-testConsecutiveExports/52751ad62937af1c337cf2fca6ca3172 2023-07-20 07:11:08,119 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/data/default/testtb-testConsecutiveExports/52751ad62937af1c337cf2fca6ca3172 2023-07-20 07:11:08,120 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/data/default/testtb-testConsecutiveExports/9d899a3184674b1fdb7c9328824d7572/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-20 07:11:08,121 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 9d899a3184674b1fdb7c9328824d7572; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61201763, jitterRate=-0.08802266418933868}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-20 07:11:08,121 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 9d899a3184674b1fdb7c9328824d7572: 2023-07-20 07:11:08,122 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testConsecutiveExports,1,1689837067711.9d899a3184674b1fdb7c9328824d7572., pid=46, masterSystemTime=1689837068100 2023-07-20 07:11:08,123 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 52751ad62937af1c337cf2fca6ca3172 2023-07-20 07:11:08,125 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testConsecutiveExports,1,1689837067711.9d899a3184674b1fdb7c9328824d7572. 2023-07-20 07:11:08,125 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=44 updating hbase:meta row=9d899a3184674b1fdb7c9328824d7572, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,44955,1689837020792 2023-07-20 07:11:08,126 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testConsecutiveExports,1,1689837067711.9d899a3184674b1fdb7c9328824d7572.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689837068125"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689837068125"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689837068125"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689837068125"}]},"ts":"1689837068125"} 2023-07-20 07:11:08,126 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testConsecutiveExports,1,1689837067711.9d899a3184674b1fdb7c9328824d7572. 2023-07-20 07:11:08,130 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/data/default/testtb-testConsecutiveExports/52751ad62937af1c337cf2fca6ca3172/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-20 07:11:08,131 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 52751ad62937af1c337cf2fca6ca3172; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72309138, jitterRate=0.07749012112617493}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-20 07:11:08,131 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 52751ad62937af1c337cf2fca6ca3172: 2023-07-20 07:11:08,131 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=46, resume processing ppid=44 2023-07-20 07:11:08,131 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=46, ppid=44, state=SUCCESS; OpenRegionProcedure 9d899a3184674b1fdb7c9328824d7572, server=jenkins-hbase4.apache.org,44955,1689837020792 in 180 msec 2023-07-20 07:11:08,131 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testConsecutiveExports,,1689837067711.52751ad62937af1c337cf2fca6ca3172., pid=45, masterSystemTime=1689837068099 2023-07-20 07:11:08,133 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=44, ppid=42, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=9d899a3184674b1fdb7c9328824d7572, ASSIGN in 347 msec 2023-07-20 07:11:08,133 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testConsecutiveExports,,1689837067711.52751ad62937af1c337cf2fca6ca3172. 2023-07-20 07:11:08,134 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testConsecutiveExports,,1689837067711.52751ad62937af1c337cf2fca6ca3172. 2023-07-20 07:11:08,134 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=52751ad62937af1c337cf2fca6ca3172, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,44777,1689837020621 2023-07-20 07:11:08,135 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testConsecutiveExports,,1689837067711.52751ad62937af1c337cf2fca6ca3172.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689837068134"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689837068134"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689837068134"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689837068134"}]},"ts":"1689837068134"} 2023-07-20 07:11:08,138 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=45, resume processing ppid=43 2023-07-20 07:11:08,138 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=45, ppid=43, state=SUCCESS; OpenRegionProcedure 52751ad62937af1c337cf2fca6ca3172, server=jenkins-hbase4.apache.org,44777,1689837020621 in 189 msec 2023-07-20 07:11:08,141 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=43, resume processing ppid=42 2023-07-20 07:11:08,141 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=43, ppid=42, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=52751ad62937af1c337cf2fca6ca3172, ASSIGN in 353 msec 2023-07-20 07:11:08,142 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-20 07:11:08,142 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689837068142"}]},"ts":"1689837068142"} 2023-07-20 07:11:08,144 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=ENABLED in hbase:meta 2023-07-20 07:11:08,148 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_POST_OPERATION 2023-07-20 07:11:08,148 DEBUG [PEWorker-2] access.PermissionStorage(175): Writing permission with rowKey testtb-testConsecutiveExports jenkins: RWXCA 2023-07-20 07:11:08,151 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=44955] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-07-20 07:11:08,153 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): regionserver:44777-0x10181911f0f0001, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-20 07:11:08,153 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): master:37415-0x10181911f0f0000, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-20 07:11:08,153 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): regionserver:44955-0x10181911f0f0003, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-20 07:11:08,153 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): regionserver:45099-0x10181911f0f0002, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-20 07:11:08,155 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-07-20 07:11:08,155 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-07-20 07:11:08,155 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-07-20 07:11:08,155 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-07-20 07:11:08,157 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=42, state=SUCCESS; CreateTableProcedure table=testtb-testConsecutiveExports in 443 msec 2023-07-20 07:11:08,321 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-20 07:11:08,321 INFO [Listener at jenkins-hbase4.apache.org/33837] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testConsecutiveExports, procId: 42 completed 2023-07-20 07:11:08,324 DEBUG [Listener at jenkins-hbase4.apache.org/33837] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testConsecutiveExports 2023-07-20 07:11:08,324 DEBUG [Listener at jenkins-hbase4.apache.org/33837] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testConsecutiveExports,,1689837067711.52751ad62937af1c337cf2fca6ca3172. 2023-07-20 07:11:08,326 INFO [Listener at jenkins-hbase4.apache.org/33837] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-20 07:11:08,338 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-20 07:11:08,338 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689837068338 (current time:1689837068338). 2023-07-20 07:11:08,338 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-20 07:11:08,339 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] zookeeper.ReadOnlyZKClient(139): Connect 0x38b675fe to 127.0.0.1:58010 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-20 07:11:08,346 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7ab59249, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-20 07:11:08,347 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-20 07:11:08,350 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:60804, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-20 07:11:08,351 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x38b675fe to 127.0.0.1:58010 2023-07-20 07:11:08,351 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-20 07:11:08,352 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] zookeeper.ReadOnlyZKClient(139): Connect 0x497a8dc3 to 127.0.0.1:58010 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-20 07:11:08,357 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@42e81897, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-20 07:11:08,358 DEBUG [hconnection-0x1419fd59-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-20 07:11:08,360 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:60820, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-20 07:11:08,364 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-20 07:11:08,367 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:40828, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-20 07:11:08,368 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x497a8dc3 to 127.0.0.1:58010 2023-07-20 07:11:08,368 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-20 07:11:08,368 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-07-20 07:11:08,369 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-20 07:11:08,369 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-20 07:11:08,372 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] procedure2.ProcedureExecutor(1029): Stored pid=47, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-20 07:11:08,373 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=47, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-20 07:11:08,374 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=47, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE; timeout=600000, timestamp=1689837668374 2023-07-20 07:11:08,374 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-20 07:11:08,374 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports 2023-07-20 07:11:08,375 DEBUG [Listener at jenkins-hbase4.apache.org/33837] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-20 07:11:08,375 DEBUG [Listener at jenkins-hbase4.apache.org/33837] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-20 07:11:08,379 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=47, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-20 07:11:08,379 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-20 07:11:08,380 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=47, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE in 8 msec 2023-07-20 07:11:08,381 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-20 07:11:08,381 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=48, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED; timeout=600000, timestamp=1689837668381 2023-07-20 07:11:08,395 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testConsecutiveExports 2023-07-20 07:11:08,395 INFO [(jenkins-hbase4.apache.org,37415,1689837019114)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testConsecutiveExports' 2023-07-20 07:11:08,395 DEBUG [(jenkins-hbase4.apache.org,37415,1689837019114)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-20 07:11:08,396 DEBUG [(jenkins-hbase4.apache.org,37415,1689837019114)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' 2023-07-20 07:11:08,397 DEBUG [(jenkins-hbase4.apache.org,37415,1689837019114)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testConsecutiveExports', kicking off acquire phase on members. 2023-07-20 07:11:08,397 DEBUG [(jenkins-hbase4.apache.org,37415,1689837019114)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37415-0x10181911f0f0000, quorum=127.0.0.1:58010, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-20 07:11:08,397 DEBUG [(jenkins-hbase4.apache.org,37415,1689837019114)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-20 07:11:08,399 DEBUG [(jenkins-hbase4.apache.org,37415,1689837019114)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44777,1689837020621 2023-07-20 07:11:08,399 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): regionserver:45099-0x10181911f0f0002, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 07:11:08,399 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): regionserver:44955-0x10181911f0f0003, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 07:11:08,399 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 07:11:08,399 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): regionserver:44777-0x10181911f0f0001, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 07:11:08,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 07:11:08,399 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 07:11:08,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 07:11:08,400 DEBUG [(jenkins-hbase4.apache.org,37415,1689837019114)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37415-0x10181911f0f0000, quorum=127.0.0.1:58010, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44777,1689837020621 2023-07-20 07:11:08,400 DEBUG [(jenkins-hbase4.apache.org,37415,1689837019114)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44955,1689837020792 2023-07-20 07:11:08,400 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 07:11:08,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 07:11:08,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-20 07:11:08,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-20 07:11:08,400 DEBUG [(jenkins-hbase4.apache.org,37415,1689837019114)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37415-0x10181911f0f0000, quorum=127.0.0.1:58010, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44955,1689837020792 2023-07-20 07:11:08,400 DEBUG [(jenkins-hbase4.apache.org,37415,1689837019114)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-20 07:11:08,400 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45099-0x10181911f0f0002, quorum=127.0.0.1:58010, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-20 07:11:08,400 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44955-0x10181911f0f0003, quorum=127.0.0.1:58010, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-20 07:11:08,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-20 07:11:08,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-07-20 07:11:08,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-20 07:11:08,401 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44777-0x10181911f0f0001, quorum=127.0.0.1:58010, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-20 07:11:08,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-07-20 07:11:08,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-20 07:11:08,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-07-20 07:11:08,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-20 07:11:08,401 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-20 07:11:08,402 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-07-20 07:11:08,402 DEBUG [member: 'jenkins-hbase4.apache.org,44777,1689837020621' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-20 07:11:08,402 DEBUG [member: 'jenkins-hbase4.apache.org,44777,1689837020621' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-20 07:11:08,404 DEBUG [member: 'jenkins-hbase4.apache.org,44777,1689837020621' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-20 07:11:08,404 DEBUG [member: 'jenkins-hbase4.apache.org,44777,1689837020621' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-07-20 07:11:08,404 DEBUG [member: 'jenkins-hbase4.apache.org,44777,1689837020621' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44777,1689837020621' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-07-20 07:11:08,404 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-20 07:11:08,404 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-20 07:11:08,405 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): master:37415-0x10181911f0f0000, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44777,1689837020621 2023-07-20 07:11:08,405 DEBUG [member: 'jenkins-hbase4.apache.org,44777,1689837020621' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-20 07:11:08,405 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44777,1689837020621 2023-07-20 07:11:08,405 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-20 07:11:08,405 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-20 07:11:08,406 DEBUG [member: 'jenkins-hbase4.apache.org,44777,1689837020621' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44777-0x10181911f0f0001, quorum=127.0.0.1:58010, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-20 07:11:08,406 DEBUG [member: 'jenkins-hbase4.apache.org,44777,1689837020621' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-20 07:11:08,406 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-07-20 07:11:08,407 DEBUG [member: 'jenkins-hbase4.apache.org,44955,1689837020792' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-20 07:11:08,407 DEBUG [member: 'jenkins-hbase4.apache.org,44955,1689837020792' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-20 07:11:08,409 DEBUG [member: 'jenkins-hbase4.apache.org,44955,1689837020792' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-20 07:11:08,409 DEBUG [member: 'jenkins-hbase4.apache.org,44955,1689837020792' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-07-20 07:11:08,409 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-07-20 07:11:08,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-20 07:11:08,409 DEBUG [member: 'jenkins-hbase4.apache.org,45099,1689837020733' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-20 07:11:08,409 DEBUG [member: 'jenkins-hbase4.apache.org,44955,1689837020792' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44955,1689837020792' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-07-20 07:11:08,409 DEBUG [member: 'jenkins-hbase4.apache.org,45099,1689837020733' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-20 07:11:08,413 DEBUG [member: 'jenkins-hbase4.apache.org,45099,1689837020733' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-20 07:11:08,413 DEBUG [member: 'jenkins-hbase4.apache.org,45099,1689837020733' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-07-20 07:11:08,413 DEBUG [member: 'jenkins-hbase4.apache.org,45099,1689837020733' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45099,1689837020733' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-07-20 07:11:08,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-20 07:11:08,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-20 07:11:08,414 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): master:37415-0x10181911f0f0000, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44955,1689837020792 2023-07-20 07:11:08,415 DEBUG [member: 'jenkins-hbase4.apache.org,44955,1689837020792' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-20 07:11:08,415 DEBUG [member: 'jenkins-hbase4.apache.org,44955,1689837020792' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44955-0x10181911f0f0003, quorum=127.0.0.1:58010, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-20 07:11:08,415 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44955,1689837020792 2023-07-20 07:11:08,415 DEBUG [member: 'jenkins-hbase4.apache.org,44955,1689837020792' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-20 07:11:08,415 DEBUG [member: 'jenkins-hbase4.apache.org,45099,1689837020733' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-20 07:11:08,416 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44777,1689837020621 2023-07-20 07:11:08,416 DEBUG [member: 'jenkins-hbase4.apache.org,45099,1689837020733' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45099-0x10181911f0f0002, quorum=127.0.0.1:58010, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-20 07:11:08,416 DEBUG [member: 'jenkins-hbase4.apache.org,45099,1689837020733' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-20 07:11:08,416 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45099,1689837020733 2023-07-20 07:11:08,416 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-20 07:11:08,417 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44777,1689837020621' joining acquired barrier for procedure 'emptySnaptb0-testConsecutiveExports' on coordinator 2023-07-20 07:11:08,417 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@58b1269[Count = 1] remaining members to acquire global barrier 2023-07-20 07:11:08,417 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44955,1689837020792 2023-07-20 07:11:08,417 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-20 07:11:08,417 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-20 07:11:08,417 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-20 07:11:08,417 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-20 07:11:08,417 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-20 07:11:08,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44955,1689837020792 2023-07-20 07:11:08,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44777,1689837020621 2023-07-20 07:11:08,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45099,1689837020733 2023-07-20 07:11:08,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-20 07:11:08,419 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44955,1689837020792' joining acquired barrier for procedure 'emptySnaptb0-testConsecutiveExports' on coordinator 2023-07-20 07:11:08,419 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@58b1269[Count = 0] remaining members to acquire global barrier 2023-07-20 07:11:08,419 DEBUG [(jenkins-hbase4.apache.org,37415,1689837019114)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testConsecutiveExports' starting 'in-barrier' execution. 2023-07-20 07:11:08,419 DEBUG [(jenkins-hbase4.apache.org,37415,1689837019114)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-20 07:11:08,425 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): regionserver:44777-0x10181911f0f0001, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-20 07:11:08,425 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): regionserver:44955-0x10181911f0f0003, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-20 07:11:08,425 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-20 07:11:08,425 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-20 07:11:08,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-20 07:11:08,425 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): regionserver:45099-0x10181911f0f0002, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-20 07:11:08,425 DEBUG [member: 'jenkins-hbase4.apache.org,44955,1689837020792' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-20 07:11:08,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-20 07:11:08,425 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-20 07:11:08,425 DEBUG [member: 'jenkins-hbase4.apache.org,44777,1689837020621' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-20 07:11:08,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-20 07:11:08,425 DEBUG [(jenkins-hbase4.apache.org,37415,1689837019114)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37415-0x10181911f0f0000, quorum=127.0.0.1:58010, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44777,1689837020621 2023-07-20 07:11:08,425 DEBUG [member: 'jenkins-hbase4.apache.org,45099,1689837020733' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-20 07:11:08,425 DEBUG [member: 'jenkins-hbase4.apache.org,45099,1689837020733' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-07-20 07:11:08,425 DEBUG [rs(jenkins-hbase4.apache.org,44955,1689837020792)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,1,1689837067711.9d899a3184674b1fdb7c9328824d7572. 2023-07-20 07:11:08,425 DEBUG [member: 'jenkins-hbase4.apache.org,44777,1689837020621' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-20 07:11:08,425 DEBUG [member: 'jenkins-hbase4.apache.org,44777,1689837020621' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-20 07:11:08,425 DEBUG [rs(jenkins-hbase4.apache.org,44777,1689837020621)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,,1689837067711.52751ad62937af1c337cf2fca6ca3172. 2023-07-20 07:11:08,426 DEBUG [(jenkins-hbase4.apache.org,37415,1689837019114)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37415-0x10181911f0f0000, quorum=127.0.0.1:58010, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44955,1689837020792 2023-07-20 07:11:08,426 DEBUG [rs(jenkins-hbase4.apache.org,44777,1689837020621)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,,1689837067711.52751ad62937af1c337cf2fca6ca3172. started... 2023-07-20 07:11:08,425 DEBUG [member: 'jenkins-hbase4.apache.org,44955,1689837020792' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-20 07:11:08,426 DEBUG [member: 'jenkins-hbase4.apache.org,44955,1689837020792' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-20 07:11:08,426 DEBUG [(jenkins-hbase4.apache.org,37415,1689837019114)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-20 07:11:08,425 DEBUG [rs(jenkins-hbase4.apache.org,44955,1689837020792)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,1,1689837067711.9d899a3184674b1fdb7c9328824d7572. started... 2023-07-20 07:11:08,425 DEBUG [member: 'jenkins-hbase4.apache.org,45099,1689837020733' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,45099,1689837020733' in zk 2023-07-20 07:11:08,426 DEBUG [rs(jenkins-hbase4.apache.org,44777,1689837020621)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 52751ad62937af1c337cf2fca6ca3172: 2023-07-20 07:11:08,427 DEBUG [rs(jenkins-hbase4.apache.org,44955,1689837020792)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 9d899a3184674b1fdb7c9328824d7572: 2023-07-20 07:11:08,427 DEBUG [rs(jenkins-hbase4.apache.org,44777,1689837020621)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,,1689837067711.52751ad62937af1c337cf2fca6ca3172.' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-07-20 07:11:08,427 DEBUG [rs(jenkins-hbase4.apache.org,44777,1689837020621)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-20 07:11:08,428 DEBUG [rs(jenkins-hbase4.apache.org,44777,1689837020621)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-20 07:11:08,428 DEBUG [rs(jenkins-hbase4.apache.org,44955,1689837020792)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,1,1689837067711.9d899a3184674b1fdb7c9328824d7572.' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-07-20 07:11:08,428 DEBUG [rs(jenkins-hbase4.apache.org,44955,1689837020792)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-20 07:11:08,428 DEBUG [rs(jenkins-hbase4.apache.org,44955,1689837020792)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-20 07:11:08,437 DEBUG [member: 'jenkins-hbase4.apache.org,45099,1689837020733' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-07-20 07:11:08,437 DEBUG [member: 'jenkins-hbase4.apache.org,45099,1689837020733' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-20 07:11:08,437 DEBUG [member: 'jenkins-hbase4.apache.org,45099,1689837020733' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-07-20 07:11:08,447 DEBUG [rs(jenkins-hbase4.apache.org,44777,1689837020621)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,,1689837067711.52751ad62937af1c337cf2fca6ca3172. completed. 2023-07-20 07:11:08,447 DEBUG [rs(jenkins-hbase4.apache.org,44777,1689837020621)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,,1689837067711.52751ad62937af1c337cf2fca6ca3172. 2023-07-20 07:11:08,447 DEBUG [member: 'jenkins-hbase4.apache.org,44777,1689837020621' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-20 07:11:08,447 DEBUG [member: 'jenkins-hbase4.apache.org,44777,1689837020621' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-20 07:11:08,447 DEBUG [member: 'jenkins-hbase4.apache.org,44777,1689837020621' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,44777,1689837020621 2023-07-20 07:11:08,447 DEBUG [member: 'jenkins-hbase4.apache.org,44777,1689837020621' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-07-20 07:11:08,447 DEBUG [member: 'jenkins-hbase4.apache.org,44777,1689837020621' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,44777,1689837020621' in zk 2023-07-20 07:11:08,448 DEBUG [rs(jenkins-hbase4.apache.org,44955,1689837020792)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,1,1689837067711.9d899a3184674b1fdb7c9328824d7572. completed. 2023-07-20 07:11:08,448 DEBUG [rs(jenkins-hbase4.apache.org,44955,1689837020792)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,1,1689837067711.9d899a3184674b1fdb7c9328824d7572. 2023-07-20 07:11:08,448 DEBUG [member: 'jenkins-hbase4.apache.org,44955,1689837020792' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-20 07:11:08,448 DEBUG [member: 'jenkins-hbase4.apache.org,44955,1689837020792' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-20 07:11:08,448 DEBUG [member: 'jenkins-hbase4.apache.org,44955,1689837020792' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,44955,1689837020792 2023-07-20 07:11:08,448 DEBUG [member: 'jenkins-hbase4.apache.org,44955,1689837020792' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-07-20 07:11:08,448 DEBUG [member: 'jenkins-hbase4.apache.org,44955,1689837020792' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,44955,1689837020792' in zk 2023-07-20 07:11:08,449 DEBUG [member: 'jenkins-hbase4.apache.org,44777,1689837020621' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-07-20 07:11:08,449 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): master:37415-0x10181911f0f0000, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44777,1689837020621 2023-07-20 07:11:08,449 DEBUG [member: 'jenkins-hbase4.apache.org,44777,1689837020621' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-20 07:11:08,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44777,1689837020621 2023-07-20 07:11:08,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-20 07:11:08,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-20 07:11:08,449 DEBUG [member: 'jenkins-hbase4.apache.org,44777,1689837020621' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-07-20 07:11:08,453 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): master:37415-0x10181911f0f0000, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44955,1689837020792 2023-07-20 07:11:08,453 DEBUG [member: 'jenkins-hbase4.apache.org,44955,1689837020792' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-07-20 07:11:08,453 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-20 07:11:08,453 DEBUG [member: 'jenkins-hbase4.apache.org,44955,1689837020792' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-20 07:11:08,453 DEBUG [member: 'jenkins-hbase4.apache.org,44955,1689837020792' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-07-20 07:11:08,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-20 07:11:08,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-20 07:11:08,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44955,1689837020792 2023-07-20 07:11:08,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44777,1689837020621 2023-07-20 07:11:08,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45099,1689837020733 2023-07-20 07:11:08,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-20 07:11:08,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-20 07:11:08,457 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44955,1689837020792 2023-07-20 07:11:08,457 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44777,1689837020621 2023-07-20 07:11:08,457 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45099,1689837020733 2023-07-20 07:11:08,458 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,44777,1689837020621': 2023-07-20 07:11:08,458 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44777,1689837020621' released barrier for procedure'emptySnaptb0-testConsecutiveExports', counting down latch. Waiting for 1 more 2023-07-20 07:11:08,458 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44955,1689837020792 2023-07-20 07:11:08,458 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-20 07:11:08,458 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-20 07:11:08,458 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-20 07:11:08,459 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-20 07:11:08,459 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-20 07:11:08,459 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44955,1689837020792 2023-07-20 07:11:08,459 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44777,1689837020621 2023-07-20 07:11:08,460 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45099,1689837020733 2023-07-20 07:11:08,460 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-20 07:11:08,460 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-20 07:11:08,460 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44955,1689837020792 2023-07-20 07:11:08,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44777,1689837020621 2023-07-20 07:11:08,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45099,1689837020733 2023-07-20 07:11:08,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,44955,1689837020792': 2023-07-20 07:11:08,462 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44955,1689837020792' released barrier for procedure'emptySnaptb0-testConsecutiveExports', counting down latch. Waiting for 0 more 2023-07-20 07:11:08,462 INFO [(jenkins-hbase4.apache.org,37415,1689837019114)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testConsecutiveExports' execution completed 2023-07-20 07:11:08,462 DEBUG [(jenkins-hbase4.apache.org,37415,1689837019114)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-20 07:11:08,462 DEBUG [(jenkins-hbase4.apache.org,37415,1689837019114)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-20 07:11:08,462 DEBUG [(jenkins-hbase4.apache.org,37415,1689837019114)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testConsecutiveExports 2023-07-20 07:11:08,462 INFO [(jenkins-hbase4.apache.org,37415,1689837019114)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testConsecutiveExportsincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-20 07:11:08,463 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): master:37415-0x10181911f0f0000, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-20 07:11:08,463 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): regionserver:45099-0x10181911f0f0002, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-20 07:11:08,463 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-20 07:11:08,463 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): regionserver:45099-0x10181911f0f0002, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 07:11:08,463 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): regionserver:44777-0x10181911f0f0001, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-20 07:11:08,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-20 07:11:08,464 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-20 07:11:08,464 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-20 07:11:08,463 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): regionserver:44955-0x10181911f0f0003, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-20 07:11:08,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-20 07:11:08,464 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-20 07:11:08,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-20 07:11:08,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-20 07:11:08,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-20 07:11:08,464 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): regionserver:44777-0x10181911f0f0001, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 07:11:08,464 DEBUG [(jenkins-hbase4.apache.org,37415,1689837019114)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37415-0x10181911f0f0000, quorum=127.0.0.1:58010, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44955,1689837020792 2023-07-20 07:11:08,464 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): regionserver:44955-0x10181911f0f0003, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 07:11:08,464 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 07:11:08,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 07:11:08,464 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 07:11:08,464 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 07:11:08,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 07:11:08,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 07:11:08,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-20 07:11:08,465 DEBUG [(jenkins-hbase4.apache.org,37415,1689837019114)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37415-0x10181911f0f0000, quorum=127.0.0.1:58010, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44777,1689837020621 2023-07-20 07:11:08,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-20 07:11:08,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-20 07:11:08,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-20 07:11:08,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-20 07:11:08,465 DEBUG [(jenkins-hbase4.apache.org,37415,1689837019114)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37415-0x10181911f0f0000, quorum=127.0.0.1:58010, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45099,1689837020733 2023-07-20 07:11:08,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-20 07:11:08,466 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-20 07:11:08,466 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44955,1689837020792 2023-07-20 07:11:08,466 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44777,1689837020621 2023-07-20 07:11:08,467 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45099,1689837020733 2023-07-20 07:11:08,467 DEBUG [(jenkins-hbase4.apache.org,37415,1689837019114)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37415-0x10181911f0f0000, quorum=127.0.0.1:58010, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44955,1689837020792 2023-07-20 07:11:08,467 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-20 07:11:08,468 DEBUG [(jenkins-hbase4.apache.org,37415,1689837019114)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37415-0x10181911f0f0000, quorum=127.0.0.1:58010, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44777,1689837020621 2023-07-20 07:11:08,468 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-20 07:11:08,468 DEBUG [(jenkins-hbase4.apache.org,37415,1689837019114)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37415-0x10181911f0f0000, quorum=127.0.0.1:58010, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45099,1689837020733 2023-07-20 07:11:08,468 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44955,1689837020792 2023-07-20 07:11:08,468 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44777,1689837020621 2023-07-20 07:11:08,469 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45099,1689837020733 2023-07-20 07:11:08,471 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): master:37415-0x10181911f0f0000, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45099,1689837020733 2023-07-20 07:11:08,471 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): master:37415-0x10181911f0f0000, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-20 07:11:08,471 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): master:37415-0x10181911f0f0000, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44777,1689837020621 2023-07-20 07:11:08,471 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): master:37415-0x10181911f0f0000, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44955,1689837020792 2023-07-20 07:11:08,471 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): regionserver:44955-0x10181911f0f0003, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 07:11:08,471 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): regionserver:45099-0x10181911f0f0002, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 07:11:08,471 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): master:37415-0x10181911f0f0000, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-20 07:11:08,471 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): regionserver:44777-0x10181911f0f0001, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 07:11:08,471 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): master:37415-0x10181911f0f0000, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45099,1689837020733 2023-07-20 07:11:08,471 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 07:11:08,471 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testConsecutiveExports 2023-07-20 07:11:08,471 DEBUG [(jenkins-hbase4.apache.org,37415,1689837019114)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-20 07:11:08,472 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testConsecutiveExports 2023-07-20 07:11:08,471 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 07:11:08,471 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): regionserver:44955-0x10181911f0f0003, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 07:11:08,471 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 07:11:08,471 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): regionserver:45099-0x10181911f0f0002, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 07:11:08,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 07:11:08,473 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => c7b48a2e62736c517f8bfa7d64fc37ac, NAME => 'testtb-testConsecutiveExports,.mob,0.c7b48a2e62736c517f8bfa7d64fc37ac.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-07-20 07:11:08,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 07:11:08,473 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-20 07:11:08,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 07:11:08,471 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): master:37415-0x10181911f0f0000, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-20 07:11:08,474 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): master:37415-0x10181911f0f0000, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44777,1689837020621 2023-07-20 07:11:08,474 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): master:37415-0x10181911f0f0000, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44955,1689837020792 2023-07-20 07:11:08,474 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): master:37415-0x10181911f0f0000, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-20 07:11:08,474 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): master:37415-0x10181911f0f0000, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-20 07:11:08,474 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 07:11:08,471 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): regionserver:44777-0x10181911f0f0001, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 07:11:08,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 07:11:08,474 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 07:11:08,474 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 07:11:08,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 07:11:08,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 07:11:08,474 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-07-20 07:11:08,475 DEBUG [Listener at jenkins-hbase4.apache.org/33837] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-20 07:11:08,476 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-20 07:11:08,476 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' is still in progress! 2023-07-20 07:11:08,477 DEBUG [Listener at jenkins-hbase4.apache.org/33837] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-20 07:11:08,483 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testConsecutiveExports 2023-07-20 07:11:08,483 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-07-20 07:11:08,509 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports to hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/.hbase-snapshot/emptySnaptb0-testConsecutiveExports 2023-07-20 07:11:08,543 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed 2023-07-20 07:11:08,543 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-07-20 07:11:08,543 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-07-20 07:11:08,544 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports at 1689837068374Completed referencing HFiles for the mob region of table: testtb-testConsecutiveExports at 1689837068483 (+109 ms)Consolidate snapshot: emptySnaptb0-testConsecutiveExports at 1689837068483Loading Region manifests for emptySnaptb0-testConsecutiveExports at 1689837068483Writing data manifest for emptySnaptb0-testConsecutiveExports at 1689837068487 (+4 ms)Verifying snapshot: emptySnaptb0-testConsecutiveExports at 1689837068502 (+15 ms)Snapshot emptySnaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed at 1689837068543 (+41 ms) 2023-07-20 07:11:08,546 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=48, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-20 07:11:08,548 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=48, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED in 171 msec 2023-07-20 07:11:08,677 DEBUG [Listener at jenkins-hbase4.apache.org/33837] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-20 07:11:08,678 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-20 07:11:08,678 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-20 07:11:08,683 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44955] regionserver.HRegion(8805): writing data to region testtb-testConsecutiveExports,1,1689837067711.9d899a3184674b1fdb7c9328824d7572. with WAL disabled. Data may be lost in the event of a crash. 2023-07-20 07:11:08,683 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44777] regionserver.HRegion(8805): writing data to region testtb-testConsecutiveExports,,1689837067711.52751ad62937af1c337cf2fca6ca3172. with WAL disabled. Data may be lost in the event of a crash. 2023-07-20 07:11:08,687 DEBUG [Listener at jenkins-hbase4.apache.org/33837] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testConsecutiveExports 2023-07-20 07:11:08,688 DEBUG [Listener at jenkins-hbase4.apache.org/33837] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testConsecutiveExports,,1689837067711.52751ad62937af1c337cf2fca6ca3172. 2023-07-20 07:11:08,688 INFO [Listener at jenkins-hbase4.apache.org/33837] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-20 07:11:08,707 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-20 07:11:08,707 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689837068707 (current time:1689837068707). 2023-07-20 07:11:08,707 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-20 07:11:08,708 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] zookeeper.ReadOnlyZKClient(139): Connect 0x771aa336 to 127.0.0.1:58010 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-20 07:11:08,725 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@d83d3d5, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-20 07:11:08,728 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-20 07:11:08,730 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:60828, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-20 07:11:08,731 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x771aa336 to 127.0.0.1:58010 2023-07-20 07:11:08,731 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-20 07:11:08,732 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] zookeeper.ReadOnlyZKClient(139): Connect 0x10828817 to 127.0.0.1:58010 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-20 07:11:08,765 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@32a39a22, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-20 07:11:08,767 DEBUG [hconnection-0x212dfad8-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-20 07:11:08,771 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:60840, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-20 07:11:08,776 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-20 07:11:08,777 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:40832, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-20 07:11:08,778 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x10828817 to 127.0.0.1:58010 2023-07-20 07:11:08,778 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-20 07:11:08,779 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-07-20 07:11:08,779 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-20 07:11:08,780 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-20 07:11:08,782 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] procedure2.ProcedureExecutor(1029): Stored pid=49, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-20 07:11:08,784 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=49, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-20 07:11:08,785 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=49, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE; timeout=600000, timestamp=1689837668785 2023-07-20 07:11:08,785 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports 2023-07-20 07:11:08,785 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-20 07:11:08,787 DEBUG [Listener at jenkins-hbase4.apache.org/33837] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-20 07:11:08,787 DEBUG [Listener at jenkins-hbase4.apache.org/33837] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-20 07:11:08,788 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=50, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-20 07:11:08,789 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=49, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-20 07:11:08,791 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=49, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE in 8 msec 2023-07-20 07:11:08,793 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=50, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-20 07:11:08,794 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=50, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED; timeout=600000, timestamp=1689837668794 2023-07-20 07:11:08,808 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testConsecutiveExports 2023-07-20 07:11:08,808 INFO [(jenkins-hbase4.apache.org,37415,1689837019114)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testConsecutiveExports' 2023-07-20 07:11:08,808 DEBUG [(jenkins-hbase4.apache.org,37415,1689837019114)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-20 07:11:08,810 DEBUG [(jenkins-hbase4.apache.org,37415,1689837019114)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testConsecutiveExports' starting 'acquire' 2023-07-20 07:11:08,810 DEBUG [(jenkins-hbase4.apache.org,37415,1689837019114)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testConsecutiveExports', kicking off acquire phase on members. 2023-07-20 07:11:08,811 DEBUG [(jenkins-hbase4.apache.org,37415,1689837019114)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37415-0x10181911f0f0000, quorum=127.0.0.1:58010, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-20 07:11:08,811 DEBUG [(jenkins-hbase4.apache.org,37415,1689837019114)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-20 07:11:08,812 DEBUG [(jenkins-hbase4.apache.org,37415,1689837019114)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44777,1689837020621 2023-07-20 07:11:08,812 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): regionserver:44777-0x10181911f0f0001, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 07:11:08,812 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): regionserver:44955-0x10181911f0f0003, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 07:11:08,812 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): regionserver:45099-0x10181911f0f0002, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 07:11:08,813 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 07:11:08,813 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 07:11:08,812 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 07:11:08,813 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 07:11:08,813 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 07:11:08,813 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 07:11:08,813 DEBUG [(jenkins-hbase4.apache.org,37415,1689837019114)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37415-0x10181911f0f0000, quorum=127.0.0.1:58010, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44777,1689837020621 2023-07-20 07:11:08,813 DEBUG [(jenkins-hbase4.apache.org,37415,1689837019114)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44955,1689837020792 2023-07-20 07:11:08,813 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-20 07:11:08,813 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-20 07:11:08,813 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-20 07:11:08,813 DEBUG [(jenkins-hbase4.apache.org,37415,1689837019114)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37415-0x10181911f0f0000, quorum=127.0.0.1:58010, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44955,1689837020792 2023-07-20 07:11:08,813 DEBUG [(jenkins-hbase4.apache.org,37415,1689837019114)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-20 07:11:08,814 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44777-0x10181911f0f0001, quorum=127.0.0.1:58010, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-20 07:11:08,814 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45099-0x10181911f0f0002, quorum=127.0.0.1:58010, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-20 07:11:08,814 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44955-0x10181911f0f0003, quorum=127.0.0.1:58010, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-20 07:11:08,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-07-20 07:11:08,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-07-20 07:11:08,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-20 07:11:08,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-20 07:11:08,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-07-20 07:11:08,814 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-20 07:11:08,814 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-20 07:11:08,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-20 07:11:08,815 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-20 07:11:08,815 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-07-20 07:11:08,815 DEBUG [member: 'jenkins-hbase4.apache.org,45099,1689837020733' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-20 07:11:08,815 DEBUG [member: 'jenkins-hbase4.apache.org,45099,1689837020733' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-20 07:11:08,819 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-07-20 07:11:08,819 DEBUG [member: 'jenkins-hbase4.apache.org,44777,1689837020621' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-20 07:11:08,820 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-07-20 07:11:08,820 DEBUG [member: 'jenkins-hbase4.apache.org,45099,1689837020733' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-20 07:11:08,821 DEBUG [member: 'jenkins-hbase4.apache.org,45099,1689837020733' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-07-20 07:11:08,821 DEBUG [member: 'jenkins-hbase4.apache.org,44955,1689837020792' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-20 07:11:08,820 DEBUG [member: 'jenkins-hbase4.apache.org,44777,1689837020621' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-20 07:11:08,821 DEBUG [member: 'jenkins-hbase4.apache.org,44955,1689837020792' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-20 07:11:08,822 DEBUG [member: 'jenkins-hbase4.apache.org,44777,1689837020621' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-20 07:11:08,822 DEBUG [member: 'jenkins-hbase4.apache.org,44777,1689837020621' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-07-20 07:11:08,821 DEBUG [member: 'jenkins-hbase4.apache.org,45099,1689837020733' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45099,1689837020733' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-07-20 07:11:08,824 DEBUG [member: 'jenkins-hbase4.apache.org,44777,1689837020621' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44777,1689837020621' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-07-20 07:11:08,824 DEBUG [member: 'jenkins-hbase4.apache.org,44955,1689837020792' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-20 07:11:08,825 DEBUG [member: 'jenkins-hbase4.apache.org,44955,1689837020792' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-07-20 07:11:08,825 DEBUG [member: 'jenkins-hbase4.apache.org,44955,1689837020792' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44955,1689837020792' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-07-20 07:11:08,826 DEBUG [member: 'jenkins-hbase4.apache.org,45099,1689837020733' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-20 07:11:08,826 DEBUG [member: 'jenkins-hbase4.apache.org,44955,1689837020792' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-20 07:11:08,826 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): master:37415-0x10181911f0f0000, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44955,1689837020792 2023-07-20 07:11:08,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44955,1689837020792 2023-07-20 07:11:08,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-20 07:11:08,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-20 07:11:08,827 DEBUG [member: 'jenkins-hbase4.apache.org,45099,1689837020733' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45099-0x10181911f0f0002, quorum=127.0.0.1:58010, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-20 07:11:08,827 DEBUG [member: 'jenkins-hbase4.apache.org,45099,1689837020733' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-20 07:11:08,827 DEBUG [member: 'jenkins-hbase4.apache.org,44777,1689837020621' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-20 07:11:08,828 DEBUG [member: 'jenkins-hbase4.apache.org,44777,1689837020621' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44777-0x10181911f0f0001, quorum=127.0.0.1:58010, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-20 07:11:08,828 DEBUG [member: 'jenkins-hbase4.apache.org,44777,1689837020621' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-20 07:11:08,827 DEBUG [member: 'jenkins-hbase4.apache.org,44955,1689837020792' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44955-0x10181911f0f0003, quorum=127.0.0.1:58010, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-20 07:11:08,828 DEBUG [member: 'jenkins-hbase4.apache.org,44955,1689837020792' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-20 07:11:08,827 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): master:37415-0x10181911f0f0000, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44777,1689837020621 2023-07-20 07:11:08,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-20 07:11:08,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-20 07:11:08,829 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-20 07:11:08,829 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44955,1689837020792 2023-07-20 07:11:08,830 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44777,1689837020621 2023-07-20 07:11:08,830 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45099,1689837020733 2023-07-20 07:11:08,830 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-20 07:11:08,831 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44955,1689837020792' joining acquired barrier for procedure 'snaptb0-testConsecutiveExports' on coordinator 2023-07-20 07:11:08,831 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@74efaae5[Count = 1] remaining members to acquire global barrier 2023-07-20 07:11:08,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44777,1689837020621 2023-07-20 07:11:08,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-20 07:11:08,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-20 07:11:08,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-20 07:11:08,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-20 07:11:08,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-20 07:11:08,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44955,1689837020792 2023-07-20 07:11:08,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44777,1689837020621 2023-07-20 07:11:08,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45099,1689837020733 2023-07-20 07:11:08,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-20 07:11:08,833 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44777,1689837020621' joining acquired barrier for procedure 'snaptb0-testConsecutiveExports' on coordinator 2023-07-20 07:11:08,833 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@74efaae5[Count = 0] remaining members to acquire global barrier 2023-07-20 07:11:08,833 DEBUG [(jenkins-hbase4.apache.org,37415,1689837019114)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testConsecutiveExports' starting 'in-barrier' execution. 2023-07-20 07:11:08,834 DEBUG [(jenkins-hbase4.apache.org,37415,1689837019114)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-20 07:11:08,840 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): regionserver:44955-0x10181911f0f0003, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-20 07:11:08,840 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): regionserver:44777-0x10181911f0f0001, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-20 07:11:08,840 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-20 07:11:08,840 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-20 07:11:08,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-20 07:11:08,840 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): regionserver:45099-0x10181911f0f0002, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-20 07:11:08,840 DEBUG [member: 'jenkins-hbase4.apache.org,44955,1689837020792' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-20 07:11:08,840 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-20 07:11:08,840 DEBUG [(jenkins-hbase4.apache.org,37415,1689837019114)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37415-0x10181911f0f0000, quorum=127.0.0.1:58010, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44955,1689837020792 2023-07-20 07:11:08,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-20 07:11:08,840 DEBUG [member: 'jenkins-hbase4.apache.org,44777,1689837020621' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-20 07:11:08,840 DEBUG [rs(jenkins-hbase4.apache.org,44955,1689837020792)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,1,1689837067711.9d899a3184674b1fdb7c9328824d7572. 2023-07-20 07:11:08,840 DEBUG [member: 'jenkins-hbase4.apache.org,44955,1689837020792' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-20 07:11:08,841 DEBUG [member: 'jenkins-hbase4.apache.org,44955,1689837020792' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-20 07:11:08,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-20 07:11:08,841 DEBUG [rs(jenkins-hbase4.apache.org,44955,1689837020792)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,1,1689837067711.9d899a3184674b1fdb7c9328824d7572. started... 2023-07-20 07:11:08,841 DEBUG [member: 'jenkins-hbase4.apache.org,45099,1689837020733' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-20 07:11:08,841 DEBUG [member: 'jenkins-hbase4.apache.org,45099,1689837020733' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-07-20 07:11:08,841 DEBUG [member: 'jenkins-hbase4.apache.org,45099,1689837020733' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,45099,1689837020733' in zk 2023-07-20 07:11:08,841 INFO [rs(jenkins-hbase4.apache.org,44955,1689837020792)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 9d899a3184674b1fdb7c9328824d7572 1/1 column families, dataSize=3.00 KB heapSize=6.72 KB 2023-07-20 07:11:08,842 DEBUG [member: 'jenkins-hbase4.apache.org,44777,1689837020621' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-20 07:11:08,842 DEBUG [member: 'jenkins-hbase4.apache.org,44777,1689837020621' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-20 07:11:08,842 DEBUG [(jenkins-hbase4.apache.org,37415,1689837019114)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37415-0x10181911f0f0000, quorum=127.0.0.1:58010, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44777,1689837020621 2023-07-20 07:11:08,842 DEBUG [(jenkins-hbase4.apache.org,37415,1689837019114)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-20 07:11:08,842 DEBUG [rs(jenkins-hbase4.apache.org,44777,1689837020621)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,,1689837067711.52751ad62937af1c337cf2fca6ca3172. 2023-07-20 07:11:08,842 DEBUG [rs(jenkins-hbase4.apache.org,44777,1689837020621)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,,1689837067711.52751ad62937af1c337cf2fca6ca3172. started... 2023-07-20 07:11:08,842 INFO [rs(jenkins-hbase4.apache.org,44777,1689837020621)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 52751ad62937af1c337cf2fca6ca3172 1/1 column families, dataSize=266 B heapSize=832 B 2023-07-20 07:11:08,852 DEBUG [member: 'jenkins-hbase4.apache.org,45099,1689837020733' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-07-20 07:11:08,853 DEBUG [member: 'jenkins-hbase4.apache.org,45099,1689837020733' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-20 07:11:08,853 DEBUG [member: 'jenkins-hbase4.apache.org,45099,1689837020733' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-07-20 07:11:08,883 INFO [rs(jenkins-hbase4.apache.org,44777,1689837020621)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202307207edd97a725e04edeab35abf178a92c57 to hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e202307207edd97a725e04edeab35abf178a92c57 2023-07-20 07:11:08,886 INFO [rs(jenkins-hbase4.apache.org,44955,1689837020792)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023072073ec61afd4014a26a9b8268c7f27e47c to hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b2023072073ec61afd4014a26a9b8268c7f27e47c 2023-07-20 07:11:08,887 DEBUG [Listener at jenkins-hbase4.apache.org/33837] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-20 07:11:08,888 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-20 07:11:08,889 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' is still in progress! 2023-07-20 07:11:08,889 DEBUG [Listener at jenkins-hbase4.apache.org/33837] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-20 07:11:08,899 INFO [rs(jenkins-hbase4.apache.org,44777,1689837020621)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=266, hasBloomFilter=true, into tmp file hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/data/default/testtb-testConsecutiveExports/52751ad62937af1c337cf2fca6ca3172/.tmp/cf/650afdccc7554d5d849e8baf60b869a4 2023-07-20 07:11:08,906 INFO [rs(jenkins-hbase4.apache.org,44955,1689837020792)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.0 K, hasBloomFilter=true, into tmp file hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/data/default/testtb-testConsecutiveExports/9d899a3184674b1fdb7c9328824d7572/.tmp/cf/cfe2e449191343928ab6ce092170b68a 2023-07-20 07:11:08,906 DEBUG [rs(jenkins-hbase4.apache.org,44777,1689837020621)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/data/default/testtb-testConsecutiveExports/52751ad62937af1c337cf2fca6ca3172/.tmp/cf/650afdccc7554d5d849e8baf60b869a4 as hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/data/default/testtb-testConsecutiveExports/52751ad62937af1c337cf2fca6ca3172/cf/650afdccc7554d5d849e8baf60b869a4 2023-07-20 07:11:08,912 INFO [rs(jenkins-hbase4.apache.org,44777,1689837020621)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/data/default/testtb-testConsecutiveExports/52751ad62937af1c337cf2fca6ca3172/cf/650afdccc7554d5d849e8baf60b869a4, entries=4, sequenceid=6, filesize=5.5 K 2023-07-20 07:11:08,913 INFO [rs(jenkins-hbase4.apache.org,44777,1689837020621)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~266 B/266, heapSize ~816 B/816, currentSize=0 B/0 for 52751ad62937af1c337cf2fca6ca3172 in 71ms, sequenceid=6, compaction requested=false 2023-07-20 07:11:08,913 DEBUG [rs(jenkins-hbase4.apache.org,44777,1689837020621)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testConsecutiveExports' 2023-07-20 07:11:08,914 DEBUG [rs(jenkins-hbase4.apache.org,44955,1689837020792)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/data/default/testtb-testConsecutiveExports/9d899a3184674b1fdb7c9328824d7572/.tmp/cf/cfe2e449191343928ab6ce092170b68a as hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/data/default/testtb-testConsecutiveExports/9d899a3184674b1fdb7c9328824d7572/cf/cfe2e449191343928ab6ce092170b68a 2023-07-20 07:11:08,914 DEBUG [rs(jenkins-hbase4.apache.org,44777,1689837020621)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 52751ad62937af1c337cf2fca6ca3172: 2023-07-20 07:11:08,914 DEBUG [rs(jenkins-hbase4.apache.org,44777,1689837020621)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,,1689837067711.52751ad62937af1c337cf2fca6ca3172.' region-info for snapshot=snaptb0-testConsecutiveExports 2023-07-20 07:11:08,915 DEBUG [rs(jenkins-hbase4.apache.org,44777,1689837020621)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-20 07:11:08,915 DEBUG [rs(jenkins-hbase4.apache.org,44777,1689837020621)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/data/default/testtb-testConsecutiveExports/52751ad62937af1c337cf2fca6ca3172/cf/650afdccc7554d5d849e8baf60b869a4] hfiles 2023-07-20 07:11:08,915 DEBUG [rs(jenkins-hbase4.apache.org,44777,1689837020621)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/data/default/testtb-testConsecutiveExports/52751ad62937af1c337cf2fca6ca3172/cf/650afdccc7554d5d849e8baf60b869a4 for snapshot=snaptb0-testConsecutiveExports 2023-07-20 07:11:08,920 INFO [rs(jenkins-hbase4.apache.org,44955,1689837020792)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/data/default/testtb-testConsecutiveExports/9d899a3184674b1fdb7c9328824d7572/cf/cfe2e449191343928ab6ce092170b68a, entries=46, sequenceid=6, filesize=12.5 K 2023-07-20 07:11:08,921 INFO [rs(jenkins-hbase4.apache.org,44955,1689837020792)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.00 KB/3070, heapSize ~6.70 KB/6864, currentSize=0 B/0 for 9d899a3184674b1fdb7c9328824d7572 in 80ms, sequenceid=6, compaction requested=false 2023-07-20 07:11:08,923 DEBUG [rs(jenkins-hbase4.apache.org,44955,1689837020792)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 9d899a3184674b1fdb7c9328824d7572: 2023-07-20 07:11:08,923 DEBUG [rs(jenkins-hbase4.apache.org,44955,1689837020792)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,1,1689837067711.9d899a3184674b1fdb7c9328824d7572.' region-info for snapshot=snaptb0-testConsecutiveExports 2023-07-20 07:11:08,923 DEBUG [rs(jenkins-hbase4.apache.org,44955,1689837020792)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-20 07:11:08,924 DEBUG [rs(jenkins-hbase4.apache.org,44955,1689837020792)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/data/default/testtb-testConsecutiveExports/9d899a3184674b1fdb7c9328824d7572/cf/cfe2e449191343928ab6ce092170b68a] hfiles 2023-07-20 07:11:08,924 DEBUG [rs(jenkins-hbase4.apache.org,44955,1689837020792)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/data/default/testtb-testConsecutiveExports/9d899a3184674b1fdb7c9328824d7572/cf/cfe2e449191343928ab6ce092170b68a for snapshot=snaptb0-testConsecutiveExports 2023-07-20 07:11:08,927 DEBUG [rs(jenkins-hbase4.apache.org,44777,1689837020621)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,,1689837067711.52751ad62937af1c337cf2fca6ca3172. completed. 2023-07-20 07:11:08,927 DEBUG [rs(jenkins-hbase4.apache.org,44777,1689837020621)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,,1689837067711.52751ad62937af1c337cf2fca6ca3172. 2023-07-20 07:11:08,927 DEBUG [member: 'jenkins-hbase4.apache.org,44777,1689837020621' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-20 07:11:08,927 DEBUG [member: 'jenkins-hbase4.apache.org,44777,1689837020621' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-20 07:11:08,927 DEBUG [member: 'jenkins-hbase4.apache.org,44777,1689837020621' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,44777,1689837020621 2023-07-20 07:11:08,927 DEBUG [member: 'jenkins-hbase4.apache.org,44777,1689837020621' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-07-20 07:11:08,927 DEBUG [member: 'jenkins-hbase4.apache.org,44777,1689837020621' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,44777,1689837020621' in zk 2023-07-20 07:11:08,934 DEBUG [member: 'jenkins-hbase4.apache.org,44777,1689837020621' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-07-20 07:11:08,934 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): master:37415-0x10181911f0f0000, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44777,1689837020621 2023-07-20 07:11:08,934 DEBUG [member: 'jenkins-hbase4.apache.org,44777,1689837020621' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-20 07:11:08,934 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44777,1689837020621 2023-07-20 07:11:08,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-20 07:11:08,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-20 07:11:08,934 DEBUG [member: 'jenkins-hbase4.apache.org,44777,1689837020621' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-07-20 07:11:08,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-20 07:11:08,937 DEBUG [rs(jenkins-hbase4.apache.org,44955,1689837020792)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,1,1689837067711.9d899a3184674b1fdb7c9328824d7572. completed. 2023-07-20 07:11:08,937 DEBUG [rs(jenkins-hbase4.apache.org,44955,1689837020792)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,1,1689837067711.9d899a3184674b1fdb7c9328824d7572. 2023-07-20 07:11:08,937 DEBUG [member: 'jenkins-hbase4.apache.org,44955,1689837020792' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-20 07:11:08,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-20 07:11:08,937 DEBUG [member: 'jenkins-hbase4.apache.org,44955,1689837020792' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-20 07:11:08,937 DEBUG [member: 'jenkins-hbase4.apache.org,44955,1689837020792' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,44955,1689837020792 2023-07-20 07:11:08,937 DEBUG [member: 'jenkins-hbase4.apache.org,44955,1689837020792' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-07-20 07:11:08,937 DEBUG [member: 'jenkins-hbase4.apache.org,44955,1689837020792' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,44955,1689837020792' in zk 2023-07-20 07:11:08,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-20 07:11:08,939 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44955,1689837020792 2023-07-20 07:11:08,942 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): master:37415-0x10181911f0f0000, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44955,1689837020792 2023-07-20 07:11:08,942 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44777,1689837020621 2023-07-20 07:11:08,942 DEBUG [member: 'jenkins-hbase4.apache.org,44955,1689837020792' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-07-20 07:11:08,942 DEBUG [member: 'jenkins-hbase4.apache.org,44955,1689837020792' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-20 07:11:08,942 DEBUG [member: 'jenkins-hbase4.apache.org,44955,1689837020792' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-07-20 07:11:08,944 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45099,1689837020733 2023-07-20 07:11:08,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-20 07:11:08,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-20 07:11:08,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44955,1689837020792 2023-07-20 07:11:08,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44777,1689837020621 2023-07-20 07:11:08,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45099,1689837020733 2023-07-20 07:11:08,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,44777,1689837020621': 2023-07-20 07:11:08,947 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44777,1689837020621' released barrier for procedure'snaptb0-testConsecutiveExports', counting down latch. Waiting for 1 more 2023-07-20 07:11:08,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44955,1689837020792 2023-07-20 07:11:08,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-20 07:11:08,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-20 07:11:08,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-20 07:11:08,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-20 07:11:08,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-20 07:11:08,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44955,1689837020792 2023-07-20 07:11:08,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44777,1689837020621 2023-07-20 07:11:08,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45099,1689837020733 2023-07-20 07:11:08,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-20 07:11:08,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-20 07:11:08,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44955,1689837020792 2023-07-20 07:11:08,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44777,1689837020621 2023-07-20 07:11:08,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45099,1689837020733 2023-07-20 07:11:08,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,44955,1689837020792': 2023-07-20 07:11:08,950 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44955,1689837020792' released barrier for procedure'snaptb0-testConsecutiveExports', counting down latch. Waiting for 0 more 2023-07-20 07:11:08,950 INFO [(jenkins-hbase4.apache.org,37415,1689837019114)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testConsecutiveExports' execution completed 2023-07-20 07:11:08,950 DEBUG [(jenkins-hbase4.apache.org,37415,1689837019114)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-20 07:11:08,950 DEBUG [(jenkins-hbase4.apache.org,37415,1689837019114)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-20 07:11:08,950 DEBUG [(jenkins-hbase4.apache.org,37415,1689837019114)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testConsecutiveExports 2023-07-20 07:11:08,950 INFO [(jenkins-hbase4.apache.org,37415,1689837019114)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testConsecutiveExportsincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-20 07:11:08,953 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): master:37415-0x10181911f0f0000, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-20 07:11:08,953 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): regionserver:45099-0x10181911f0f0002, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-20 07:11:08,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-20 07:11:08,953 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): regionserver:44955-0x10181911f0f0003, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-20 07:11:08,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-20 07:11:08,953 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-20 07:11:08,953 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-20 07:11:08,953 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): regionserver:45099-0x10181911f0f0002, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 07:11:08,953 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): regionserver:44777-0x10181911f0f0001, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-20 07:11:08,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-20 07:11:08,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-20 07:11:08,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-20 07:11:08,953 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): regionserver:44955-0x10181911f0f0003, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 07:11:08,953 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-20 07:11:08,953 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): regionserver:44777-0x10181911f0f0001, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 07:11:08,954 DEBUG [(jenkins-hbase4.apache.org,37415,1689837019114)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37415-0x10181911f0f0000, quorum=127.0.0.1:58010, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44955,1689837020792 2023-07-20 07:11:08,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-20 07:11:08,954 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 07:11:08,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-20 07:11:08,954 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 07:11:08,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 07:11:08,954 DEBUG [(jenkins-hbase4.apache.org,37415,1689837019114)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37415-0x10181911f0f0000, quorum=127.0.0.1:58010, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44777,1689837020621 2023-07-20 07:11:08,954 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 07:11:08,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 07:11:08,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 07:11:08,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-20 07:11:08,954 DEBUG [(jenkins-hbase4.apache.org,37415,1689837019114)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37415-0x10181911f0f0000, quorum=127.0.0.1:58010, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45099,1689837020733 2023-07-20 07:11:08,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-20 07:11:08,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-20 07:11:08,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-20 07:11:08,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-20 07:11:08,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-20 07:11:08,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44955,1689837020792 2023-07-20 07:11:08,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44777,1689837020621 2023-07-20 07:11:08,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45099,1689837020733 2023-07-20 07:11:08,957 DEBUG [(jenkins-hbase4.apache.org,37415,1689837019114)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37415-0x10181911f0f0000, quorum=127.0.0.1:58010, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44955,1689837020792 2023-07-20 07:11:08,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-20 07:11:08,958 DEBUG [(jenkins-hbase4.apache.org,37415,1689837019114)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37415-0x10181911f0f0000, quorum=127.0.0.1:58010, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44777,1689837020621 2023-07-20 07:11:08,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-20 07:11:08,958 DEBUG [(jenkins-hbase4.apache.org,37415,1689837019114)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37415-0x10181911f0f0000, quorum=127.0.0.1:58010, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45099,1689837020733 2023-07-20 07:11:08,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44955,1689837020792 2023-07-20 07:11:08,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44777,1689837020621 2023-07-20 07:11:08,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45099,1689837020733 2023-07-20 07:11:08,965 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): regionserver:44777-0x10181911f0f0001, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 07:11:08,965 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): regionserver:44955-0x10181911f0f0003, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 07:11:08,965 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): master:37415-0x10181911f0f0000, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45099,1689837020733 2023-07-20 07:11:08,965 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 07:11:08,965 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): master:37415-0x10181911f0f0000, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-20 07:11:08,965 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): regionserver:44777-0x10181911f0f0001, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 07:11:08,965 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): regionserver:45099-0x10181911f0f0002, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 07:11:08,966 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): master:37415-0x10181911f0f0000, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44777,1689837020621 2023-07-20 07:11:08,966 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 07:11:08,965 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): regionserver:44955-0x10181911f0f0003, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 07:11:08,965 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 07:11:08,966 DEBUG [(jenkins-hbase4.apache.org,37415,1689837019114)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-20 07:11:08,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 07:11:08,966 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testConsecutiveExports 2023-07-20 07:11:08,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 07:11:08,968 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testConsecutiveExports 2023-07-20 07:11:08,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 07:11:08,966 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): master:37415-0x10181911f0f0000, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44955,1689837020792 2023-07-20 07:11:08,968 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => c7b48a2e62736c517f8bfa7d64fc37ac, NAME => 'testtb-testConsecutiveExports,.mob,0.c7b48a2e62736c517f8bfa7d64fc37ac.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testConsecutiveExports 2023-07-20 07:11:08,966 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): regionserver:45099-0x10181911f0f0002, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 07:11:08,968 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-20 07:11:08,968 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 07:11:08,968 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): master:37415-0x10181911f0f0000, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-20 07:11:08,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 07:11:08,968 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 07:11:08,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 07:11:08,968 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): master:37415-0x10181911f0f0000, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45099,1689837020733 2023-07-20 07:11:08,968 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): master:37415-0x10181911f0f0000, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-20 07:11:08,968 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): master:37415-0x10181911f0f0000, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44777,1689837020621 2023-07-20 07:11:08,968 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): master:37415-0x10181911f0f0000, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44955,1689837020792 2023-07-20 07:11:08,968 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): master:37415-0x10181911f0f0000, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-20 07:11:08,968 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 07:11:08,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 07:11:08,968 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): master:37415-0x10181911f0f0000, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-20 07:11:08,969 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b2023072073ec61afd4014a26a9b8268c7f27e47c, hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e202307207edd97a725e04edeab35abf178a92c57] mob files 2023-07-20 07:11:08,969 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b2023072073ec61afd4014a26a9b8268c7f27e47c 2023-07-20 07:11:08,969 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e202307207edd97a725e04edeab35abf178a92c57 2023-07-20 07:11:08,981 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testConsecutiveExports 2023-07-20 07:11:08,981 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-20 07:11:09,009 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports to hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-20 07:11:09,034 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed 2023-07-20 07:11:09,035 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-20 07:11:09,035 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-20 07:11:09,035 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports at 1689837068785Completed referencing HFiles for the mob region of table: testtb-testConsecutiveExports at 1689837068981 (+196 ms)Consolidate snapshot: snaptb0-testConsecutiveExports at 1689837068981Loading Region manifests for snaptb0-testConsecutiveExports at 1689837068981Writing data manifest for snaptb0-testConsecutiveExports at 1689837068988 (+7 ms)Verifying snapshot: snaptb0-testConsecutiveExports at 1689837068999 (+11 ms)Snapshot snaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed at 1689837069034 (+35 ms) 2023-07-20 07:11:09,038 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=50, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-20 07:11:09,039 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=50, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED in 251 msec 2023-07-20 07:11:09,089 DEBUG [Listener at jenkins-hbase4.apache.org/33837] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-20 07:11:09,090 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-20 07:11:09,090 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-20 07:11:09,091 INFO [Listener at jenkins-hbase4.apache.org/33837] snapshot.TestExportSnapshot(389): Local export destination path: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c07d5e8c-eba2-0ae8-aa3a-b7afa648e7e7/local-export-1689837069091 2023-07-20 07:11:09,091 INFO [Listener at jenkins-hbase4.apache.org/33837] snapshot.TestExportSnapshot(255): tgtFsUri=file:///, tgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c07d5e8c-eba2-0ae8-aa3a-b7afa648e7e7/local-export-1689837069091, rawTgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c07d5e8c-eba2-0ae8-aa3a-b7afa648e7e7/local-export-1689837069091, srcFsUri=hdfs://localhost:39649, srcDir=hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b 2023-07-20 07:11:09,118 DEBUG [Listener at jenkins-hbase4.apache.org/33837] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:39649, inputRoot=hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b 2023-07-20 07:11:09,118 DEBUG [Listener at jenkins-hbase4.apache.org/33837] snapshot.ExportSnapshot(999): outputFs=org.apache.hadoop.fs.LocalFileSystem@7d10dec8, outputRoot=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c07d5e8c-eba2-0ae8-aa3a-b7afa648e7e7/local-export-1689837069091, skipTmp=false, initialOutputSnapshotDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c07d5e8c-eba2-0ae8-aa3a-b7afa648e7e7/local-export-1689837069091/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-20 07:11:09,118 INFO [Listener at jenkins-hbase4.apache.org/33837] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:39649, inputRoot=hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b, snapshotDir=hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/.hbase-snapshot/snaptb0-testConsecutiveExports. 2023-07-20 07:11:09,131 INFO [Listener at jenkins-hbase4.apache.org/33837] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/.hbase-snapshot/snaptb0-testConsecutiveExports to file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c07d5e8c-eba2-0ae8-aa3a-b7afa648e7e7/local-export-1689837069091/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-20 07:11:09,150 DEBUG [Listener at jenkins-hbase4.apache.org/33837] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-20 07:11:09,151 DEBUG [Listener at jenkins-hbase4.apache.org/33837] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-20 07:11:09,151 DEBUG [Listener at jenkins-hbase4.apache.org/33837] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-20 07:11:09,151 DEBUG [Listener at jenkins-hbase4.apache.org/33837] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-20 07:11:09,152 DEBUG [Listener at jenkins-hbase4.apache.org/33837] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-20 07:11:09,152 DEBUG [Listener at jenkins-hbase4.apache.org/33837] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-20 07:11:09,152 DEBUG [Listener at jenkins-hbase4.apache.org/33837] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-20 07:11:09,234 DEBUG [Listener at jenkins-hbase4.apache.org/33837] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c07d5e8c-eba2-0ae8-aa3a-b7afa648e7e7/hadoop-1094143388382283090.jar 2023-07-20 07:11:09,234 DEBUG [Listener at jenkins-hbase4.apache.org/33837] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-20 07:11:09,235 DEBUG [Listener at jenkins-hbase4.apache.org/33837] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-20 07:11:09,235 DEBUG [Listener at jenkins-hbase4.apache.org/33837] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-20 07:11:09,235 DEBUG [Listener at jenkins-hbase4.apache.org/33837] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-20 07:11:09,236 DEBUG [Listener at jenkins-hbase4.apache.org/33837] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-20 07:11:09,236 DEBUG [Listener at jenkins-hbase4.apache.org/33837] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-20 07:11:09,237 DEBUG [Listener at jenkins-hbase4.apache.org/33837] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-20 07:11:09,237 DEBUG [Listener at jenkins-hbase4.apache.org/33837] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-20 07:11:09,238 DEBUG [Listener at jenkins-hbase4.apache.org/33837] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-20 07:11:09,238 DEBUG [Listener at jenkins-hbase4.apache.org/33837] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-20 07:11:09,238 DEBUG [Listener at jenkins-hbase4.apache.org/33837] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-20 07:11:09,239 DEBUG [Listener at jenkins-hbase4.apache.org/33837] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-20 07:11:09,239 DEBUG [Listener at jenkins-hbase4.apache.org/33837] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-20 07:11:09,240 DEBUG [Listener at jenkins-hbase4.apache.org/33837] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-20 07:11:09,240 DEBUG [Listener at jenkins-hbase4.apache.org/33837] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-20 07:11:09,240 DEBUG [Listener at jenkins-hbase4.apache.org/33837] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-20 07:11:09,241 DEBUG [Listener at jenkins-hbase4.apache.org/33837] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-20 07:11:09,241 DEBUG [Listener at jenkins-hbase4.apache.org/33837] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-20 07:11:09,242 DEBUG [Listener at jenkins-hbase4.apache.org/33837] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-20 07:11:09,242 DEBUG [Listener at jenkins-hbase4.apache.org/33837] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-20 07:11:09,242 DEBUG [Listener at jenkins-hbase4.apache.org/33837] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-20 07:11:09,243 DEBUG [Listener at jenkins-hbase4.apache.org/33837] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-20 07:11:09,243 DEBUG [Listener at jenkins-hbase4.apache.org/33837] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-20 07:11:09,732 WARN [Listener at jenkins-hbase4.apache.org/33837] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-20 07:11:09,734 INFO [Listener at jenkins-hbase4.apache.org/33837] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testConsecutiveExports' hfile list 2023-07-20 07:11:09,736 DEBUG [Listener at jenkins-hbase4.apache.org/33837] snapshot.ExportSnapshot(671): export split=0 size=30.8 K 2023-07-20 07:11:11,756 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-20 07:11:11,756 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-20 07:11:11,760 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689837028633_0002_000001 (auth:SIMPLE) 2023-07-20 07:11:12,558 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689837028633_0003_000001 (auth:SIMPLE) 2023-07-20 07:11:13,005 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-20 07:11:17,351 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689837028633_0003_000001 (auth:SIMPLE) 2023-07-20 07:11:19,604 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689837028633_0003_000001 (auth:SIMPLE) 2023-07-20 07:11:22,811 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689837028633_0003_000001 (auth:SIMPLE) 2023-07-20 07:11:23,927 INFO [Listener at jenkins-hbase4.apache.org/33837] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-20 07:11:23,927 INFO [Listener at jenkins-hbase4.apache.org/33837] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-20 07:11:23,931 INFO [Listener at jenkins-hbase4.apache.org/33837] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testConsecutiveExports 2023-07-20 07:11:23,932 INFO [Listener at jenkins-hbase4.apache.org/33837] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-20 07:11:23,932 INFO [Listener at jenkins-hbase4.apache.org/33837] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-20 07:11:23,932 DEBUG [Listener at jenkins-hbase4.apache.org/33837] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_759529442_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/.hbase-snapshot/snaptb0-testConsecutiveExports at hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-20 07:11:23,934 DEBUG [Listener at jenkins-hbase4.apache.org/33837] snapshot.TestExportSnapshot(367): hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-07-20 07:11:23,935 DEBUG [Listener at jenkins-hbase4.apache.org/33837] snapshot.TestExportSnapshot(367): hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-07-20 07:11:23,935 DEBUG [Listener at jenkins-hbase4.apache.org/33837] snapshot.TestExportSnapshot(362): List files in org.apache.hadoop.fs.LocalFileSystem@2be45767 in root file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c07d5e8c-eba2-0ae8-aa3a-b7afa648e7e7/local-export-1689837069091/.hbase-snapshot/snaptb0-testConsecutiveExports at file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c07d5e8c-eba2-0ae8-aa3a-b7afa648e7e7/local-export-1689837069091/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-20 07:11:23,935 DEBUG [Listener at jenkins-hbase4.apache.org/33837] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c07d5e8c-eba2-0ae8-aa3a-b7afa648e7e7/local-export-1689837069091/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-07-20 07:11:23,935 DEBUG [Listener at jenkins-hbase4.apache.org/33837] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c07d5e8c-eba2-0ae8-aa3a-b7afa648e7e7/local-export-1689837069091/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-07-20 07:11:23,937 INFO [Listener at jenkins-hbase4.apache.org/33837] snapshot.TestExportSnapshot(255): tgtFsUri=file:///, tgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c07d5e8c-eba2-0ae8-aa3a-b7afa648e7e7/local-export-1689837069091, rawTgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c07d5e8c-eba2-0ae8-aa3a-b7afa648e7e7/local-export-1689837069091, srcFsUri=hdfs://localhost:39649, srcDir=hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b 2023-07-20 07:11:23,961 DEBUG [Listener at jenkins-hbase4.apache.org/33837] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:39649, inputRoot=hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b 2023-07-20 07:11:23,961 DEBUG [Listener at jenkins-hbase4.apache.org/33837] snapshot.ExportSnapshot(999): outputFs=org.apache.hadoop.fs.LocalFileSystem@d515020, outputRoot=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c07d5e8c-eba2-0ae8-aa3a-b7afa648e7e7/local-export-1689837069091, skipTmp=false, initialOutputSnapshotDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c07d5e8c-eba2-0ae8-aa3a-b7afa648e7e7/local-export-1689837069091/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-20 07:11:23,961 INFO [Listener at jenkins-hbase4.apache.org/33837] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:39649, inputRoot=hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b, snapshotDir=hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/.hbase-snapshot/snaptb0-testConsecutiveExports. 2023-07-20 07:11:23,976 INFO [Listener at jenkins-hbase4.apache.org/33837] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/.hbase-snapshot/snaptb0-testConsecutiveExports to file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c07d5e8c-eba2-0ae8-aa3a-b7afa648e7e7/local-export-1689837069091/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-20 07:11:23,990 DEBUG [Listener at jenkins-hbase4.apache.org/33837] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-20 07:11:23,990 DEBUG [Listener at jenkins-hbase4.apache.org/33837] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-20 07:11:23,990 DEBUG [Listener at jenkins-hbase4.apache.org/33837] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-20 07:11:23,991 DEBUG [Listener at jenkins-hbase4.apache.org/33837] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-20 07:11:23,991 DEBUG [Listener at jenkins-hbase4.apache.org/33837] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-20 07:11:23,991 DEBUG [Listener at jenkins-hbase4.apache.org/33837] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-20 07:11:23,992 DEBUG [Listener at jenkins-hbase4.apache.org/33837] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-20 07:11:24,073 DEBUG [Listener at jenkins-hbase4.apache.org/33837] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c07d5e8c-eba2-0ae8-aa3a-b7afa648e7e7/hadoop-4439714477694147881.jar 2023-07-20 07:11:24,073 DEBUG [Listener at jenkins-hbase4.apache.org/33837] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-20 07:11:24,074 DEBUG [Listener at jenkins-hbase4.apache.org/33837] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-20 07:11:24,074 DEBUG [Listener at jenkins-hbase4.apache.org/33837] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-20 07:11:24,075 DEBUG [Listener at jenkins-hbase4.apache.org/33837] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-20 07:11:24,076 DEBUG [Listener at jenkins-hbase4.apache.org/33837] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-20 07:11:24,076 DEBUG [Listener at jenkins-hbase4.apache.org/33837] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-20 07:11:24,077 DEBUG [Listener at jenkins-hbase4.apache.org/33837] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-20 07:11:24,077 DEBUG [Listener at jenkins-hbase4.apache.org/33837] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-20 07:11:24,078 DEBUG [Listener at jenkins-hbase4.apache.org/33837] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-20 07:11:24,078 DEBUG [Listener at jenkins-hbase4.apache.org/33837] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-20 07:11:24,079 DEBUG [Listener at jenkins-hbase4.apache.org/33837] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-20 07:11:24,080 DEBUG [Listener at jenkins-hbase4.apache.org/33837] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-20 07:11:24,080 DEBUG [Listener at jenkins-hbase4.apache.org/33837] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-20 07:11:24,081 DEBUG [Listener at jenkins-hbase4.apache.org/33837] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-20 07:11:24,081 DEBUG [Listener at jenkins-hbase4.apache.org/33837] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-20 07:11:24,082 DEBUG [Listener at jenkins-hbase4.apache.org/33837] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-20 07:11:24,083 DEBUG [Listener at jenkins-hbase4.apache.org/33837] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-20 07:11:24,083 DEBUG [Listener at jenkins-hbase4.apache.org/33837] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-20 07:11:24,084 DEBUG [Listener at jenkins-hbase4.apache.org/33837] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-20 07:11:24,084 DEBUG [Listener at jenkins-hbase4.apache.org/33837] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-20 07:11:24,084 DEBUG [Listener at jenkins-hbase4.apache.org/33837] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-20 07:11:24,085 DEBUG [Listener at jenkins-hbase4.apache.org/33837] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-20 07:11:24,085 DEBUG [Listener at jenkins-hbase4.apache.org/33837] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-20 07:11:24,632 WARN [Listener at jenkins-hbase4.apache.org/33837] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-20 07:11:24,634 INFO [Listener at jenkins-hbase4.apache.org/33837] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testConsecutiveExports' hfile list 2023-07-20 07:11:24,636 DEBUG [Listener at jenkins-hbase4.apache.org/33837] snapshot.ExportSnapshot(671): export split=0 size=30.8 K 2023-07-20 07:11:28,988 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-20 07:11:28,989 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-20 07:11:28,992 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689837028633_0003_000001 (auth:SIMPLE) 2023-07-20 07:11:29,773 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689837028633_0004_000001 (auth:SIMPLE) 2023-07-20 07:11:34,370 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689837028633_0004_000001 (auth:SIMPLE) 2023-07-20 07:11:36,684 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689837028633_0004_000001 (auth:SIMPLE) 2023-07-20 07:11:40,854 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689837028633_0004_000001 (auth:SIMPLE) 2023-07-20 07:11:42,877 INFO [Listener at jenkins-hbase4.apache.org/33837] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-20 07:11:42,878 INFO [Listener at jenkins-hbase4.apache.org/33837] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-20 07:11:42,889 INFO [Listener at jenkins-hbase4.apache.org/33837] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testConsecutiveExports 2023-07-20 07:11:42,889 INFO [Listener at jenkins-hbase4.apache.org/33837] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-20 07:11:42,890 INFO [Listener at jenkins-hbase4.apache.org/33837] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-20 07:11:42,890 DEBUG [Listener at jenkins-hbase4.apache.org/33837] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_759529442_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/.hbase-snapshot/snaptb0-testConsecutiveExports at hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-20 07:11:42,899 DEBUG [Listener at jenkins-hbase4.apache.org/33837] snapshot.TestExportSnapshot(367): hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-07-20 07:11:42,899 DEBUG [Listener at jenkins-hbase4.apache.org/33837] snapshot.TestExportSnapshot(367): hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-07-20 07:11:42,899 DEBUG [Listener at jenkins-hbase4.apache.org/33837] snapshot.TestExportSnapshot(362): List files in org.apache.hadoop.fs.LocalFileSystem@2be45767 in root file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c07d5e8c-eba2-0ae8-aa3a-b7afa648e7e7/local-export-1689837069091/.hbase-snapshot/snaptb0-testConsecutiveExports at file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c07d5e8c-eba2-0ae8-aa3a-b7afa648e7e7/local-export-1689837069091/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-20 07:11:42,899 DEBUG [Listener at jenkins-hbase4.apache.org/33837] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c07d5e8c-eba2-0ae8-aa3a-b7afa648e7e7/local-export-1689837069091/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-07-20 07:11:42,900 DEBUG [Listener at jenkins-hbase4.apache.org/33837] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c07d5e8c-eba2-0ae8-aa3a-b7afa648e7e7/local-export-1689837069091/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-07-20 07:11:42,916 INFO [Listener at jenkins-hbase4.apache.org/33837] client.HBaseAdmin$15(890): Started disable of testtb-testConsecutiveExports 2023-07-20 07:11:42,917 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testConsecutiveExports 2023-07-20 07:11:42,918 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] procedure2.ProcedureExecutor(1029): Stored pid=51, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testConsecutiveExports 2023-07-20 07:11:42,928 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689837102928"}]},"ts":"1689837102928"} 2023-07-20 07:11:42,929 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-07-20 07:11:42,930 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=DISABLING in hbase:meta 2023-07-20 07:11:42,932 INFO [PEWorker-5] procedure.DisableTableProcedure(293): Set testtb-testConsecutiveExports to state=DISABLING 2023-07-20 07:11:42,933 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=52, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=52751ad62937af1c337cf2fca6ca3172, UNASSIGN}, {pid=53, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=9d899a3184674b1fdb7c9328824d7572, UNASSIGN}] 2023-07-20 07:11:42,936 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=52, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=52751ad62937af1c337cf2fca6ca3172, UNASSIGN 2023-07-20 07:11:42,936 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=53, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=9d899a3184674b1fdb7c9328824d7572, UNASSIGN 2023-07-20 07:11:42,937 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=52 updating hbase:meta row=52751ad62937af1c337cf2fca6ca3172, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,44777,1689837020621 2023-07-20 07:11:42,937 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=53 updating hbase:meta row=9d899a3184674b1fdb7c9328824d7572, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,44955,1689837020792 2023-07-20 07:11:42,937 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,,1689837067711.52751ad62937af1c337cf2fca6ca3172.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689837102937"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689837102937"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689837102937"}]},"ts":"1689837102937"} 2023-07-20 07:11:42,937 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,1,1689837067711.9d899a3184674b1fdb7c9328824d7572.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689837102937"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689837102937"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689837102937"}]},"ts":"1689837102937"} 2023-07-20 07:11:42,940 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=54, ppid=52, state=RUNNABLE; CloseRegionProcedure 52751ad62937af1c337cf2fca6ca3172, server=jenkins-hbase4.apache.org,44777,1689837020621}] 2023-07-20 07:11:42,941 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=55, ppid=53, state=RUNNABLE; CloseRegionProcedure 9d899a3184674b1fdb7c9328824d7572, server=jenkins-hbase4.apache.org,44955,1689837020792}] 2023-07-20 07:11:43,030 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-07-20 07:11:43,093 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 52751ad62937af1c337cf2fca6ca3172 2023-07-20 07:11:43,093 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 52751ad62937af1c337cf2fca6ca3172, disabling compactions & flushes 2023-07-20 07:11:43,093 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,,1689837067711.52751ad62937af1c337cf2fca6ca3172. 2023-07-20 07:11:43,093 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,,1689837067711.52751ad62937af1c337cf2fca6ca3172. 2023-07-20 07:11:43,093 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,,1689837067711.52751ad62937af1c337cf2fca6ca3172. after waiting 0 ms 2023-07-20 07:11:43,093 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,,1689837067711.52751ad62937af1c337cf2fca6ca3172. 2023-07-20 07:11:43,099 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 9d899a3184674b1fdb7c9328824d7572 2023-07-20 07:11:43,099 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 9d899a3184674b1fdb7c9328824d7572, disabling compactions & flushes 2023-07-20 07:11:43,099 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,1,1689837067711.9d899a3184674b1fdb7c9328824d7572. 2023-07-20 07:11:43,100 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,1,1689837067711.9d899a3184674b1fdb7c9328824d7572. 2023-07-20 07:11:43,100 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,1,1689837067711.9d899a3184674b1fdb7c9328824d7572. after waiting 0 ms 2023-07-20 07:11:43,100 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,1,1689837067711.9d899a3184674b1fdb7c9328824d7572. 2023-07-20 07:11:43,114 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/data/default/testtb-testConsecutiveExports/52751ad62937af1c337cf2fca6ca3172/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-20 07:11:43,114 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-20 07:11:43,115 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,,1689837067711.52751ad62937af1c337cf2fca6ca3172. 2023-07-20 07:11:43,115 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 52751ad62937af1c337cf2fca6ca3172: 2023-07-20 07:11:43,116 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/data/default/testtb-testConsecutiveExports/9d899a3184674b1fdb7c9328824d7572/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-20 07:11:43,117 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-20 07:11:43,118 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,1,1689837067711.9d899a3184674b1fdb7c9328824d7572. 2023-07-20 07:11:43,118 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 9d899a3184674b1fdb7c9328824d7572: 2023-07-20 07:11:43,118 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 52751ad62937af1c337cf2fca6ca3172 2023-07-20 07:11:43,121 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=52 updating hbase:meta row=52751ad62937af1c337cf2fca6ca3172, regionState=CLOSED 2023-07-20 07:11:43,122 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 9d899a3184674b1fdb7c9328824d7572 2023-07-20 07:11:43,122 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,,1689837067711.52751ad62937af1c337cf2fca6ca3172.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689837103121"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689837103121"}]},"ts":"1689837103121"} 2023-07-20 07:11:43,123 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=53 updating hbase:meta row=9d899a3184674b1fdb7c9328824d7572, regionState=CLOSED 2023-07-20 07:11:43,123 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,1,1689837067711.9d899a3184674b1fdb7c9328824d7572.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689837103123"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689837103123"}]},"ts":"1689837103123"} 2023-07-20 07:11:43,128 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=54, resume processing ppid=52 2023-07-20 07:11:43,129 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=54, ppid=52, state=SUCCESS; CloseRegionProcedure 52751ad62937af1c337cf2fca6ca3172, server=jenkins-hbase4.apache.org,44777,1689837020621 in 185 msec 2023-07-20 07:11:43,130 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=55, resume processing ppid=53 2023-07-20 07:11:43,130 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=55, ppid=53, state=SUCCESS; CloseRegionProcedure 9d899a3184674b1fdb7c9328824d7572, server=jenkins-hbase4.apache.org,44955,1689837020792 in 185 msec 2023-07-20 07:11:43,143 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=52, ppid=51, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=52751ad62937af1c337cf2fca6ca3172, UNASSIGN in 196 msec 2023-07-20 07:11:43,144 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=53, resume processing ppid=51 2023-07-20 07:11:43,145 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=53, ppid=51, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=9d899a3184674b1fdb7c9328824d7572, UNASSIGN in 197 msec 2023-07-20 07:11:43,145 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689837103145"}]},"ts":"1689837103145"} 2023-07-20 07:11:43,147 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=DISABLED in hbase:meta 2023-07-20 07:11:43,150 INFO [PEWorker-4] procedure.DisableTableProcedure(305): Set testtb-testConsecutiveExports to state=DISABLED 2023-07-20 07:11:43,156 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=51, state=SUCCESS; DisableTableProcedure table=testtb-testConsecutiveExports in 237 msec 2023-07-20 07:11:43,232 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-07-20 07:11:43,232 INFO [Listener at jenkins-hbase4.apache.org/33837] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testConsecutiveExports, procId: 51 completed 2023-07-20 07:11:43,233 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testConsecutiveExports 2023-07-20 07:11:43,234 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] procedure2.ProcedureExecutor(1029): Stored pid=56, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-20 07:11:43,236 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=56, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-20 07:11:43,237 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] access.PermissionStorage(259): Removing permissions of removed table testtb-testConsecutiveExports 2023-07-20 07:11:43,237 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=56, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-20 07:11:43,240 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=44955] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testConsecutiveExports 2023-07-20 07:11:43,243 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): master:37415-0x10181911f0f0000, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-20 07:11:43,243 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): regionserver:44777-0x10181911f0f0001, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-20 07:11:43,243 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): regionserver:45099-0x10181911f0f0002, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-20 07:11:43,243 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): regionserver:44955-0x10181911f0f0003, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-20 07:11:43,244 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-07-20 07:11:43,244 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-07-20 07:11:43,244 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-07-20 07:11:43,244 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-07-20 07:11:43,245 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): regionserver:45099-0x10181911f0f0002, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-20 07:11:43,245 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): regionserver:44777-0x10181911f0f0001, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-20 07:11:43,245 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): regionserver:44955-0x10181911f0f0003, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-20 07:11:43,245 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/.tmp/data/default/testtb-testConsecutiveExports/52751ad62937af1c337cf2fca6ca3172 2023-07-20 07:11:43,245 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): regionserver:44777-0x10181911f0f0001, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-20 07:11:43,245 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/.tmp/data/default/testtb-testConsecutiveExports/9d899a3184674b1fdb7c9328824d7572 2023-07-20 07:11:43,245 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): master:37415-0x10181911f0f0000, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-20 07:11:43,245 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): regionserver:45099-0x10181911f0f0002, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-20 07:11:43,245 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): master:37415-0x10181911f0f0000, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-20 07:11:43,245 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): regionserver:44955-0x10181911f0f0003, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-20 07:11:43,246 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] master.MasterRpcServices(1230): Checking to see if procedure is done pid=56 2023-07-20 07:11:43,247 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/.tmp/data/default/testtb-testConsecutiveExports/52751ad62937af1c337cf2fca6ca3172/cf, FileablePath, hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/.tmp/data/default/testtb-testConsecutiveExports/52751ad62937af1c337cf2fca6ca3172/recovered.edits] 2023-07-20 07:11:43,247 DEBUG [HFileArchiver-14] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/.tmp/data/default/testtb-testConsecutiveExports/9d899a3184674b1fdb7c9328824d7572/cf, FileablePath, hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/.tmp/data/default/testtb-testConsecutiveExports/9d899a3184674b1fdb7c9328824d7572/recovered.edits] 2023-07-20 07:11:43,252 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/.tmp/data/default/testtb-testConsecutiveExports/52751ad62937af1c337cf2fca6ca3172/cf/650afdccc7554d5d849e8baf60b869a4 to hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/archive/data/default/testtb-testConsecutiveExports/52751ad62937af1c337cf2fca6ca3172/cf/650afdccc7554d5d849e8baf60b869a4 2023-07-20 07:11:43,252 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/.tmp/data/default/testtb-testConsecutiveExports/9d899a3184674b1fdb7c9328824d7572/cf/cfe2e449191343928ab6ce092170b68a to hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/archive/data/default/testtb-testConsecutiveExports/9d899a3184674b1fdb7c9328824d7572/cf/cfe2e449191343928ab6ce092170b68a 2023-07-20 07:11:43,256 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/.tmp/data/default/testtb-testConsecutiveExports/52751ad62937af1c337cf2fca6ca3172/recovered.edits/9.seqid to hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/archive/data/default/testtb-testConsecutiveExports/52751ad62937af1c337cf2fca6ca3172/recovered.edits/9.seqid 2023-07-20 07:11:43,256 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/.tmp/data/default/testtb-testConsecutiveExports/9d899a3184674b1fdb7c9328824d7572/recovered.edits/9.seqid to hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/archive/data/default/testtb-testConsecutiveExports/9d899a3184674b1fdb7c9328824d7572/recovered.edits/9.seqid 2023-07-20 07:11:43,256 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/.tmp/data/default/testtb-testConsecutiveExports/52751ad62937af1c337cf2fca6ca3172 2023-07-20 07:11:43,256 DEBUG [HFileArchiver-14] backup.HFileArchiver(596): Deleted hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/.tmp/data/default/testtb-testConsecutiveExports/9d899a3184674b1fdb7c9328824d7572 2023-07-20 07:11:43,257 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testConsecutiveExports regions 2023-07-20 07:11:43,257 DEBUG [PEWorker-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac 2023-07-20 07:11:43,258 DEBUG [PEWorker-2] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf] 2023-07-20 07:11:43,261 DEBUG [PEWorker-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b2023072073ec61afd4014a26a9b8268c7f27e47c to hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/archive/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b2023072073ec61afd4014a26a9b8268c7f27e47c 2023-07-20 07:11:43,263 DEBUG [PEWorker-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e202307207edd97a725e04edeab35abf178a92c57 to hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/archive/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e202307207edd97a725e04edeab35abf178a92c57 2023-07-20 07:11:43,263 DEBUG [PEWorker-2] backup.HFileArchiver(596): Deleted hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac 2023-07-20 07:11:43,266 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=56, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-20 07:11:43,268 WARN [PEWorker-2] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testConsecutiveExports from hbase:meta 2023-07-20 07:11:43,270 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(421): Removing 'testtb-testConsecutiveExports' descriptor. 2023-07-20 07:11:43,272 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=56, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-20 07:11:43,272 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(411): Removing 'testtb-testConsecutiveExports' from region states. 2023-07-20 07:11:43,272 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports,,1689837067711.52751ad62937af1c337cf2fca6ca3172.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689837103272"}]},"ts":"9223372036854775807"} 2023-07-20 07:11:43,272 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports,1,1689837067711.9d899a3184674b1fdb7c9328824d7572.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689837103272"}]},"ts":"9223372036854775807"} 2023-07-20 07:11:43,274 INFO [PEWorker-2] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-20 07:11:43,274 DEBUG [PEWorker-2] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 52751ad62937af1c337cf2fca6ca3172, NAME => 'testtb-testConsecutiveExports,,1689837067711.52751ad62937af1c337cf2fca6ca3172.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 9d899a3184674b1fdb7c9328824d7572, NAME => 'testtb-testConsecutiveExports,1,1689837067711.9d899a3184674b1fdb7c9328824d7572.', STARTKEY => '1', ENDKEY => ''}] 2023-07-20 07:11:43,274 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(415): Marking 'testtb-testConsecutiveExports' as deleted. 2023-07-20 07:11:43,274 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689837103274"}]},"ts":"9223372036854775807"} 2023-07-20 07:11:43,276 INFO [PEWorker-2] hbase.MetaTableAccessor(1658): Deleted table testtb-testConsecutiveExports state from META 2023-07-20 07:11:43,279 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(130): Finished pid=56, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-20 07:11:43,280 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=56, state=SUCCESS; DeleteTableProcedure table=testtb-testConsecutiveExports in 46 msec 2023-07-20 07:11:43,347 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] master.MasterRpcServices(1230): Checking to see if procedure is done pid=56 2023-07-20 07:11:43,347 INFO [Listener at jenkins-hbase4.apache.org/33837] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testConsecutiveExports, procId: 56 completed 2023-07-20 07:11:43,360 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testConsecutiveExports" 2023-07-20 07:11:43,362 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testConsecutiveExports 2023-07-20 07:11:43,364 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testConsecutiveExports" 2023-07-20 07:11:43,366 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testConsecutiveExports 2023-07-20 07:11:43,394 INFO [Listener at jenkins-hbase4.apache.org/33837] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testConsecutiveExports Thread=745 (was 764), OpenFileDescriptor=897 (was 937), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=430 (was 330) - SystemLoadAverage LEAK? -, ProcessCount=185 (was 183) - ProcessCount LEAK? -, AvailableMemoryMB=2389 (was 2705) 2023-07-20 07:11:43,394 WARN [Listener at jenkins-hbase4.apache.org/33837] hbase.ResourceChecker(130): Thread=745 is superior to 500 2023-07-20 07:11:43,415 INFO [Listener at jenkins-hbase4.apache.org/33837] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithMergeRegion Thread=745, OpenFileDescriptor=897, MaxFileDescriptor=60000, SystemLoadAverage=430, ProcessCount=185, AvailableMemoryMB=2388 2023-07-20 07:11:43,415 WARN [Listener at jenkins-hbase4.apache.org/33837] hbase.ResourceChecker(130): Thread=745 is superior to 500 2023-07-20 07:11:43,417 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-07-20 07:11:43,418 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] procedure2.ProcedureExecutor(1029): Stored pid=57, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-20 07:11:43,420 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_PRE_OPERATION 2023-07-20 07:11:43,420 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithMergeRegion" procId is: 57 2023-07-20 07:11:43,421 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-20 07:11:43,421 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-20 07:11:43,424 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/7d2b0a3e96cd9a8c2702f7abb84fdddb 2023-07-20 07:11:43,424 DEBUG [HFileArchiver-16] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/e4d8af6d8f4af1788629d227b0d2d3e6 2023-07-20 07:11:43,424 DEBUG [HFileArchiver-16] backup.HFileArchiver(153): Directory hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/e4d8af6d8f4af1788629d227b0d2d3e6 empty. 2023-07-20 07:11:43,425 DEBUG [HFileArchiver-15] backup.HFileArchiver(153): Directory hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/7d2b0a3e96cd9a8c2702f7abb84fdddb empty. 2023-07-20 07:11:43,425 DEBUG [HFileArchiver-16] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/e4d8af6d8f4af1788629d227b0d2d3e6 2023-07-20 07:11:43,425 DEBUG [HFileArchiver-15] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/7d2b0a3e96cd9a8c2702f7abb84fdddb 2023-07-20 07:11:43,425 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion regions 2023-07-20 07:11:43,438 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/.tabledesc/.tableinfo.0000000001 2023-07-20 07:11:43,440 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(7675): creating {ENCODED => e4d8af6d8f4af1788629d227b0d2d3e6, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1689837103416.e4d8af6d8f4af1788629d227b0d2d3e6.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/.tmp 2023-07-20 07:11:43,440 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(7675): creating {ENCODED => 7d2b0a3e96cd9a8c2702f7abb84fdddb, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1689837103416.7d2b0a3e96cd9a8c2702f7abb84fdddb.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/.tmp 2023-07-20 07:11:43,453 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,,1689837103416.7d2b0a3e96cd9a8c2702f7abb84fdddb.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-20 07:11:43,453 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1604): Closing 7d2b0a3e96cd9a8c2702f7abb84fdddb, disabling compactions & flushes 2023-07-20 07:11:43,453 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,1,1689837103416.e4d8af6d8f4af1788629d227b0d2d3e6.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-20 07:11:43,453 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,,1689837103416.7d2b0a3e96cd9a8c2702f7abb84fdddb. 2023-07-20 07:11:43,453 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1604): Closing e4d8af6d8f4af1788629d227b0d2d3e6, disabling compactions & flushes 2023-07-20 07:11:43,453 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,,1689837103416.7d2b0a3e96cd9a8c2702f7abb84fdddb. 2023-07-20 07:11:43,454 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,1,1689837103416.e4d8af6d8f4af1788629d227b0d2d3e6. 2023-07-20 07:11:43,454 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,,1689837103416.7d2b0a3e96cd9a8c2702f7abb84fdddb. after waiting 0 ms 2023-07-20 07:11:43,454 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1689837103416.e4d8af6d8f4af1788629d227b0d2d3e6. 2023-07-20 07:11:43,454 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,,1689837103416.7d2b0a3e96cd9a8c2702f7abb84fdddb. 2023-07-20 07:11:43,454 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1689837103416.e4d8af6d8f4af1788629d227b0d2d3e6. after waiting 0 ms 2023-07-20 07:11:43,454 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,,1689837103416.7d2b0a3e96cd9a8c2702f7abb84fdddb. 2023-07-20 07:11:43,454 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,1,1689837103416.e4d8af6d8f4af1788629d227b0d2d3e6. 2023-07-20 07:11:43,454 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1558): Region close journal for 7d2b0a3e96cd9a8c2702f7abb84fdddb: 2023-07-20 07:11:43,454 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,1,1689837103416.e4d8af6d8f4af1788629d227b0d2d3e6. 2023-07-20 07:11:43,454 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1558): Region close journal for e4d8af6d8f4af1788629d227b0d2d3e6: 2023-07-20 07:11:43,456 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_ADD_TO_META 2023-07-20 07:11:43,457 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689837103416.7d2b0a3e96cd9a8c2702f7abb84fdddb.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689837103457"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689837103457"}]},"ts":"1689837103457"} 2023-07-20 07:11:43,457 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689837103416.e4d8af6d8f4af1788629d227b0d2d3e6.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689837103457"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689837103457"}]},"ts":"1689837103457"} 2023-07-20 07:11:43,463 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-20 07:11:43,464 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-20 07:11:43,464 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689837103464"}]},"ts":"1689837103464"} 2023-07-20 07:11:43,465 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=ENABLING in hbase:meta 2023-07-20 07:11:43,469 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-20 07:11:43,470 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-20 07:11:43,470 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-20 07:11:43,470 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-20 07:11:43,470 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-20 07:11:43,470 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=7d2b0a3e96cd9a8c2702f7abb84fdddb, ASSIGN}, {pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=e4d8af6d8f4af1788629d227b0d2d3e6, ASSIGN}] 2023-07-20 07:11:43,472 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=e4d8af6d8f4af1788629d227b0d2d3e6, ASSIGN 2023-07-20 07:11:43,472 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=7d2b0a3e96cd9a8c2702f7abb84fdddb, ASSIGN 2023-07-20 07:11:43,473 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=e4d8af6d8f4af1788629d227b0d2d3e6, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,44777,1689837020621; forceNewPlan=false, retain=false 2023-07-20 07:11:43,473 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=7d2b0a3e96cd9a8c2702f7abb84fdddb, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,45099,1689837020733; forceNewPlan=false, retain=false 2023-07-20 07:11:43,522 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-20 07:11:43,623 INFO [jenkins-hbase4:37415] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-20 07:11:43,627 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=58 updating hbase:meta row=7d2b0a3e96cd9a8c2702f7abb84fdddb, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,45099,1689837020733 2023-07-20 07:11:43,627 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=59 updating hbase:meta row=e4d8af6d8f4af1788629d227b0d2d3e6, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,44777,1689837020621 2023-07-20 07:11:43,627 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689837103416.7d2b0a3e96cd9a8c2702f7abb84fdddb.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689837103627"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689837103627"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689837103627"}]},"ts":"1689837103627"} 2023-07-20 07:11:43,627 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689837103416.e4d8af6d8f4af1788629d227b0d2d3e6.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689837103627"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689837103627"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689837103627"}]},"ts":"1689837103627"} 2023-07-20 07:11:43,629 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=60, ppid=59, state=RUNNABLE; OpenRegionProcedure e4d8af6d8f4af1788629d227b0d2d3e6, server=jenkins-hbase4.apache.org,44777,1689837020621}] 2023-07-20 07:11:43,630 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=61, ppid=58, state=RUNNABLE; OpenRegionProcedure 7d2b0a3e96cd9a8c2702f7abb84fdddb, server=jenkins-hbase4.apache.org,45099,1689837020733}] 2023-07-20 07:11:43,724 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-20 07:11:43,788 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion,,1689837103416.7d2b0a3e96cd9a8c2702f7abb84fdddb. 2023-07-20 07:11:43,788 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 7d2b0a3e96cd9a8c2702f7abb84fdddb, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1689837103416.7d2b0a3e96cd9a8c2702f7abb84fdddb.', STARTKEY => '', ENDKEY => '1'} 2023-07-20 07:11:43,789 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion,,1689837103416.7d2b0a3e96cd9a8c2702f7abb84fdddb. service=AccessControlService 2023-07-20 07:11:43,789 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion,1,1689837103416.e4d8af6d8f4af1788629d227b0d2d3e6. 2023-07-20 07:11:43,789 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-20 07:11:43,789 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => e4d8af6d8f4af1788629d227b0d2d3e6, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1689837103416.e4d8af6d8f4af1788629d227b0d2d3e6.', STARTKEY => '1', ENDKEY => ''} 2023-07-20 07:11:43,789 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion 7d2b0a3e96cd9a8c2702f7abb84fdddb 2023-07-20 07:11:43,789 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,,1689837103416.7d2b0a3e96cd9a8c2702f7abb84fdddb.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-20 07:11:43,789 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 7d2b0a3e96cd9a8c2702f7abb84fdddb 2023-07-20 07:11:43,789 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion,1,1689837103416.e4d8af6d8f4af1788629d227b0d2d3e6. service=AccessControlService 2023-07-20 07:11:43,789 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 7d2b0a3e96cd9a8c2702f7abb84fdddb 2023-07-20 07:11:43,790 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-20 07:11:43,790 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion e4d8af6d8f4af1788629d227b0d2d3e6 2023-07-20 07:11:43,790 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,1,1689837103416.e4d8af6d8f4af1788629d227b0d2d3e6.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-20 07:11:43,790 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for e4d8af6d8f4af1788629d227b0d2d3e6 2023-07-20 07:11:43,790 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for e4d8af6d8f4af1788629d227b0d2d3e6 2023-07-20 07:11:43,791 INFO [StoreOpener-7d2b0a3e96cd9a8c2702f7abb84fdddb-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 7d2b0a3e96cd9a8c2702f7abb84fdddb 2023-07-20 07:11:43,791 INFO [StoreOpener-e4d8af6d8f4af1788629d227b0d2d3e6-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region e4d8af6d8f4af1788629d227b0d2d3e6 2023-07-20 07:11:43,793 DEBUG [StoreOpener-7d2b0a3e96cd9a8c2702f7abb84fdddb-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/data/default/testtb-testExportFileSystemStateWithMergeRegion/7d2b0a3e96cd9a8c2702f7abb84fdddb/cf 2023-07-20 07:11:43,793 DEBUG [StoreOpener-7d2b0a3e96cd9a8c2702f7abb84fdddb-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/data/default/testtb-testExportFileSystemStateWithMergeRegion/7d2b0a3e96cd9a8c2702f7abb84fdddb/cf 2023-07-20 07:11:43,793 DEBUG [StoreOpener-e4d8af6d8f4af1788629d227b0d2d3e6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/data/default/testtb-testExportFileSystemStateWithMergeRegion/e4d8af6d8f4af1788629d227b0d2d3e6/cf 2023-07-20 07:11:43,793 DEBUG [StoreOpener-e4d8af6d8f4af1788629d227b0d2d3e6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/data/default/testtb-testExportFileSystemStateWithMergeRegion/e4d8af6d8f4af1788629d227b0d2d3e6/cf 2023-07-20 07:11:43,794 INFO [StoreOpener-7d2b0a3e96cd9a8c2702f7abb84fdddb-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 7d2b0a3e96cd9a8c2702f7abb84fdddb columnFamilyName cf 2023-07-20 07:11:43,794 INFO [StoreOpener-e4d8af6d8f4af1788629d227b0d2d3e6-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e4d8af6d8f4af1788629d227b0d2d3e6 columnFamilyName cf 2023-07-20 07:11:43,796 INFO [StoreOpener-e4d8af6d8f4af1788629d227b0d2d3e6-1] regionserver.HStore(310): Store=e4d8af6d8f4af1788629d227b0d2d3e6/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-20 07:11:43,796 INFO [StoreOpener-7d2b0a3e96cd9a8c2702f7abb84fdddb-1] regionserver.HStore(310): Store=7d2b0a3e96cd9a8c2702f7abb84fdddb/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-20 07:11:43,797 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/data/default/testtb-testExportFileSystemStateWithMergeRegion/7d2b0a3e96cd9a8c2702f7abb84fdddb 2023-07-20 07:11:43,798 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/data/default/testtb-testExportFileSystemStateWithMergeRegion/7d2b0a3e96cd9a8c2702f7abb84fdddb 2023-07-20 07:11:43,798 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/data/default/testtb-testExportFileSystemStateWithMergeRegion/e4d8af6d8f4af1788629d227b0d2d3e6 2023-07-20 07:11:43,799 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/data/default/testtb-testExportFileSystemStateWithMergeRegion/e4d8af6d8f4af1788629d227b0d2d3e6 2023-07-20 07:11:43,802 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for e4d8af6d8f4af1788629d227b0d2d3e6 2023-07-20 07:11:43,804 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 7d2b0a3e96cd9a8c2702f7abb84fdddb 2023-07-20 07:11:43,810 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/data/default/testtb-testExportFileSystemStateWithMergeRegion/e4d8af6d8f4af1788629d227b0d2d3e6/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-20 07:11:43,811 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened e4d8af6d8f4af1788629d227b0d2d3e6; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70038552, jitterRate=0.04365575313568115}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-20 07:11:43,811 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for e4d8af6d8f4af1788629d227b0d2d3e6: 2023-07-20 07:11:43,813 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/data/default/testtb-testExportFileSystemStateWithMergeRegion/7d2b0a3e96cd9a8c2702f7abb84fdddb/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-20 07:11:43,814 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 7d2b0a3e96cd9a8c2702f7abb84fdddb; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72344557, jitterRate=0.07801790535449982}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-20 07:11:43,814 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 7d2b0a3e96cd9a8c2702f7abb84fdddb: 2023-07-20 07:11:43,815 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion,1,1689837103416.e4d8af6d8f4af1788629d227b0d2d3e6., pid=60, masterSystemTime=1689837103781 2023-07-20 07:11:43,815 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion,,1689837103416.7d2b0a3e96cd9a8c2702f7abb84fdddb., pid=61, masterSystemTime=1689837103781 2023-07-20 07:11:43,817 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion,1,1689837103416.e4d8af6d8f4af1788629d227b0d2d3e6. 2023-07-20 07:11:43,817 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion,1,1689837103416.e4d8af6d8f4af1788629d227b0d2d3e6. 2023-07-20 07:11:43,817 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=59 updating hbase:meta row=e4d8af6d8f4af1788629d227b0d2d3e6, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,44777,1689837020621 2023-07-20 07:11:43,817 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689837103416.e4d8af6d8f4af1788629d227b0d2d3e6.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689837103817"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689837103817"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689837103817"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689837103817"}]},"ts":"1689837103817"} 2023-07-20 07:11:43,818 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion,,1689837103416.7d2b0a3e96cd9a8c2702f7abb84fdddb. 2023-07-20 07:11:43,818 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion,,1689837103416.7d2b0a3e96cd9a8c2702f7abb84fdddb. 2023-07-20 07:11:43,819 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=58 updating hbase:meta row=7d2b0a3e96cd9a8c2702f7abb84fdddb, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,45099,1689837020733 2023-07-20 07:11:43,819 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689837103416.7d2b0a3e96cd9a8c2702f7abb84fdddb.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689837103819"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689837103819"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689837103819"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689837103819"}]},"ts":"1689837103819"} 2023-07-20 07:11:43,828 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=60, resume processing ppid=59 2023-07-20 07:11:43,829 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=60, ppid=59, state=SUCCESS; OpenRegionProcedure e4d8af6d8f4af1788629d227b0d2d3e6, server=jenkins-hbase4.apache.org,44777,1689837020621 in 191 msec 2023-07-20 07:11:43,831 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=61, resume processing ppid=58 2023-07-20 07:11:43,831 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=59, ppid=57, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=e4d8af6d8f4af1788629d227b0d2d3e6, ASSIGN in 359 msec 2023-07-20 07:11:43,831 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=61, ppid=58, state=SUCCESS; OpenRegionProcedure 7d2b0a3e96cd9a8c2702f7abb84fdddb, server=jenkins-hbase4.apache.org,45099,1689837020733 in 193 msec 2023-07-20 07:11:43,833 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=58, resume processing ppid=57 2023-07-20 07:11:43,833 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=58, ppid=57, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=7d2b0a3e96cd9a8c2702f7abb84fdddb, ASSIGN in 361 msec 2023-07-20 07:11:43,833 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-20 07:11:43,834 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689837103834"}]},"ts":"1689837103834"} 2023-07-20 07:11:43,835 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=ENABLED in hbase:meta 2023-07-20 07:11:43,838 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_POST_OPERATION 2023-07-20 07:11:43,838 DEBUG [PEWorker-3] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithMergeRegion jenkins: RWXCA 2023-07-20 07:11:43,840 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=44955] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-07-20 07:11:43,845 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): regionserver:44777-0x10181911f0f0001, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-20 07:11:43,845 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): regionserver:45099-0x10181911f0f0002, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-20 07:11:43,845 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): master:37415-0x10181911f0f0000, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-20 07:11:43,845 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): regionserver:44955-0x10181911f0f0003, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-20 07:11:43,847 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-20 07:11:43,847 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-20 07:11:43,847 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-20 07:11:43,847 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-20 07:11:43,851 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=57, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 430 msec 2023-07-20 07:11:44,025 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-20 07:11:44,025 INFO [Listener at jenkins-hbase4.apache.org/33837] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 57 completed 2023-07-20 07:11:44,028 DEBUG [Listener at jenkins-hbase4.apache.org/33837] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithMergeRegion 2023-07-20 07:11:44,028 DEBUG [Listener at jenkins-hbase4.apache.org/33837] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithMergeRegion,,1689837103416.7d2b0a3e96cd9a8c2702f7abb84fdddb. 2023-07-20 07:11:44,032 INFO [Listener at jenkins-hbase4.apache.org/33837] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-20 07:11:44,049 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-20 07:11:44,049 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689837104049 (current time:1689837104049). 2023-07-20 07:11:44,049 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-20 07:11:44,050 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] zookeeper.ReadOnlyZKClient(139): Connect 0x249a84fb to 127.0.0.1:58010 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-20 07:11:44,060 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@43c44546, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-20 07:11:44,061 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-20 07:11:44,065 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:34210, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-20 07:11:44,066 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x249a84fb to 127.0.0.1:58010 2023-07-20 07:11:44,067 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-20 07:11:44,067 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] zookeeper.ReadOnlyZKClient(139): Connect 0x1da0b475 to 127.0.0.1:58010 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-20 07:11:44,077 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6d6d4666, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-20 07:11:44,083 DEBUG [hconnection-0xc62c0f8-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-20 07:11:44,084 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:34226, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-20 07:11:44,089 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-20 07:11:44,093 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:44836, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-20 07:11:44,094 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1da0b475 to 127.0.0.1:58010 2023-07-20 07:11:44,094 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-20 07:11:44,094 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-07-20 07:11:44,097 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-20 07:11:44,097 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-20 07:11:44,100 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] procedure2.ProcedureExecutor(1029): Stored pid=62, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-20 07:11:44,102 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=62, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-20 07:11:44,104 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=62, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE; timeout=600000, timestamp=1689837704104 2023-07-20 07:11:44,104 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion 2023-07-20 07:11:44,106 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-20 07:11:44,107 DEBUG [Listener at jenkins-hbase4.apache.org/33837] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-20 07:11:44,107 DEBUG [Listener at jenkins-hbase4.apache.org/33837] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-20 07:11:44,112 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=62, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-20 07:11:44,114 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=63, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-20 07:11:44,115 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=62, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE in 13 msec 2023-07-20 07:11:44,117 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=63, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-20 07:11:44,118 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=63, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED; timeout=600000, timestamp=1689837704118 2023-07-20 07:11:44,127 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 07:11:44,127 INFO [(jenkins-hbase4.apache.org,37415,1689837019114)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' 2023-07-20 07:11:44,128 DEBUG [(jenkins-hbase4.apache.org,37415,1689837019114)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-20 07:11:44,129 DEBUG [(jenkins-hbase4.apache.org,37415,1689837019114)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' 2023-07-20 07:11:44,129 DEBUG [(jenkins-hbase4.apache.org,37415,1689837019114)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion', kicking off acquire phase on members. 2023-07-20 07:11:44,130 DEBUG [(jenkins-hbase4.apache.org,37415,1689837019114)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37415-0x10181911f0f0000, quorum=127.0.0.1:58010, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 07:11:44,130 DEBUG [(jenkins-hbase4.apache.org,37415,1689837019114)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 07:11:44,132 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): regionserver:45099-0x10181911f0f0002, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 07:11:44,132 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): regionserver:44777-0x10181911f0f0001, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 07:11:44,132 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 07:11:44,132 DEBUG [(jenkins-hbase4.apache.org,37415,1689837019114)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44777,1689837020621 2023-07-20 07:11:44,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 07:11:44,132 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 07:11:44,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 07:11:44,132 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): regionserver:44955-0x10181911f0f0003, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 07:11:44,132 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 07:11:44,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 07:11:44,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 07:11:44,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 07:11:44,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 07:11:44,133 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45099-0x10181911f0f0002, quorum=127.0.0.1:58010, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 07:11:44,133 DEBUG [(jenkins-hbase4.apache.org,37415,1689837019114)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37415-0x10181911f0f0000, quorum=127.0.0.1:58010, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44777,1689837020621 2023-07-20 07:11:44,133 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44777-0x10181911f0f0001, quorum=127.0.0.1:58010, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 07:11:44,133 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44955-0x10181911f0f0003, quorum=127.0.0.1:58010, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 07:11:44,133 DEBUG [(jenkins-hbase4.apache.org,37415,1689837019114)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45099,1689837020733 2023-07-20 07:11:44,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-07-20 07:11:44,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 07:11:44,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-07-20 07:11:44,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-07-20 07:11:44,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 07:11:44,134 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-20 07:11:44,134 DEBUG [(jenkins-hbase4.apache.org,37415,1689837019114)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37415-0x10181911f0f0000, quorum=127.0.0.1:58010, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45099,1689837020733 2023-07-20 07:11:44,134 DEBUG [(jenkins-hbase4.apache.org,37415,1689837019114)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-20 07:11:44,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 07:11:44,134 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-20 07:11:44,134 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-20 07:11:44,134 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 07:11:44,134 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 07:11:44,134 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 07:11:44,134 DEBUG [member: 'jenkins-hbase4.apache.org,44955,1689837020792' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-20 07:11:44,134 DEBUG [member: 'jenkins-hbase4.apache.org,44777,1689837020621' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-20 07:11:44,134 DEBUG [member: 'jenkins-hbase4.apache.org,44955,1689837020792' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-20 07:11:44,135 DEBUG [member: 'jenkins-hbase4.apache.org,44777,1689837020621' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-20 07:11:44,136 DEBUG [member: 'jenkins-hbase4.apache.org,44955,1689837020792' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-20 07:11:44,137 DEBUG [member: 'jenkins-hbase4.apache.org,44955,1689837020792' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-20 07:11:44,137 DEBUG [member: 'jenkins-hbase4.apache.org,44955,1689837020792' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44955,1689837020792' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-20 07:11:44,134 DEBUG [member: 'jenkins-hbase4.apache.org,45099,1689837020733' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-20 07:11:44,137 DEBUG [member: 'jenkins-hbase4.apache.org,44777,1689837020621' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-20 07:11:44,137 DEBUG [member: 'jenkins-hbase4.apache.org,44777,1689837020621' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-20 07:11:44,137 DEBUG [member: 'jenkins-hbase4.apache.org,44777,1689837020621' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44777,1689837020621' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-20 07:11:44,137 DEBUG [member: 'jenkins-hbase4.apache.org,45099,1689837020733' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-20 07:11:44,138 DEBUG [member: 'jenkins-hbase4.apache.org,45099,1689837020733' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-20 07:11:44,138 DEBUG [member: 'jenkins-hbase4.apache.org,45099,1689837020733' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-20 07:11:44,138 DEBUG [member: 'jenkins-hbase4.apache.org,45099,1689837020733' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45099,1689837020733' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-20 07:11:44,139 DEBUG [member: 'jenkins-hbase4.apache.org,44955,1689837020792' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 07:11:44,140 DEBUG [member: 'jenkins-hbase4.apache.org,45099,1689837020733' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 07:11:44,140 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): master:37415-0x10181911f0f0000, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44777,1689837020621 2023-07-20 07:11:44,140 DEBUG [member: 'jenkins-hbase4.apache.org,44777,1689837020621' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 07:11:44,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44777,1689837020621 2023-07-20 07:11:44,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-20 07:11:44,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-20 07:11:44,140 DEBUG [member: 'jenkins-hbase4.apache.org,44955,1689837020792' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44955-0x10181911f0f0003, quorum=127.0.0.1:58010, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 07:11:44,140 DEBUG [member: 'jenkins-hbase4.apache.org,45099,1689837020733' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45099-0x10181911f0f0002, quorum=127.0.0.1:58010, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 07:11:44,140 DEBUG [member: 'jenkins-hbase4.apache.org,45099,1689837020733' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-20 07:11:44,140 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): master:37415-0x10181911f0f0000, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45099,1689837020733 2023-07-20 07:11:44,140 DEBUG [member: 'jenkins-hbase4.apache.org,44955,1689837020792' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-20 07:11:44,141 DEBUG [member: 'jenkins-hbase4.apache.org,44777,1689837020621' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44777-0x10181911f0f0001, quorum=127.0.0.1:58010, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 07:11:44,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-20 07:11:44,141 DEBUG [member: 'jenkins-hbase4.apache.org,44777,1689837020621' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-20 07:11:44,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-20 07:11:44,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 07:11:44,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44955,1689837020792 2023-07-20 07:11:44,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44777,1689837020621 2023-07-20 07:11:44,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45099,1689837020733 2023-07-20 07:11:44,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-20 07:11:44,143 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44777,1689837020621' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-07-20 07:11:44,143 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2310c865[Count = 1] remaining members to acquire global barrier 2023-07-20 07:11:44,143 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45099,1689837020733 2023-07-20 07:11:44,143 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-20 07:11:44,143 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-20 07:11:44,143 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-20 07:11:44,143 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-20 07:11:44,144 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 07:11:44,144 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44955,1689837020792 2023-07-20 07:11:44,144 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44777,1689837020621 2023-07-20 07:11:44,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45099,1689837020733 2023-07-20 07:11:44,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-20 07:11:44,147 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,45099,1689837020733' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-07-20 07:11:44,147 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2310c865[Count = 0] remaining members to acquire global barrier 2023-07-20 07:11:44,147 DEBUG [(jenkins-hbase4.apache.org,37415,1689837019114)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'in-barrier' execution. 2023-07-20 07:11:44,147 DEBUG [(jenkins-hbase4.apache.org,37415,1689837019114)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 07:11:44,148 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): regionserver:45099-0x10181911f0f0002, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 07:11:44,148 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): regionserver:44777-0x10181911f0f0001, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 07:11:44,148 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 07:11:44,148 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 07:11:44,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 07:11:44,148 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): regionserver:44955-0x10181911f0f0003, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 07:11:44,148 DEBUG [(jenkins-hbase4.apache.org,37415,1689837019114)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37415-0x10181911f0f0000, quorum=127.0.0.1:58010, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44777,1689837020621 2023-07-20 07:11:44,148 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 07:11:44,148 DEBUG [member: 'jenkins-hbase4.apache.org,44777,1689837020621' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-20 07:11:44,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 07:11:44,149 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 07:11:44,149 DEBUG [member: 'jenkins-hbase4.apache.org,44777,1689837020621' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-20 07:11:44,149 DEBUG [member: 'jenkins-hbase4.apache.org,44955,1689837020792' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-20 07:11:44,149 DEBUG [rs(jenkins-hbase4.apache.org,44777,1689837020621)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1689837103416.e4d8af6d8f4af1788629d227b0d2d3e6. 2023-07-20 07:11:44,149 DEBUG [(jenkins-hbase4.apache.org,37415,1689837019114)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37415-0x10181911f0f0000, quorum=127.0.0.1:58010, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45099,1689837020733 2023-07-20 07:11:44,149 DEBUG [(jenkins-hbase4.apache.org,37415,1689837019114)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-20 07:11:44,149 DEBUG [member: 'jenkins-hbase4.apache.org,45099,1689837020733' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-20 07:11:44,149 DEBUG [rs(jenkins-hbase4.apache.org,44777,1689837020621)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1689837103416.e4d8af6d8f4af1788629d227b0d2d3e6. started... 2023-07-20 07:11:44,149 DEBUG [member: 'jenkins-hbase4.apache.org,44955,1689837020792' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-20 07:11:44,149 DEBUG [member: 'jenkins-hbase4.apache.org,45099,1689837020733' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-20 07:11:44,149 DEBUG [member: 'jenkins-hbase4.apache.org,45099,1689837020733' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-20 07:11:44,149 DEBUG [member: 'jenkins-hbase4.apache.org,44777,1689837020621' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-20 07:11:44,151 DEBUG [rs(jenkins-hbase4.apache.org,44777,1689837020621)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for e4d8af6d8f4af1788629d227b0d2d3e6: 2023-07-20 07:11:44,151 DEBUG [rs(jenkins-hbase4.apache.org,45099,1689837020733)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1689837103416.7d2b0a3e96cd9a8c2702f7abb84fdddb. 2023-07-20 07:11:44,149 DEBUG [member: 'jenkins-hbase4.apache.org,44955,1689837020792' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,44955,1689837020792' in zk 2023-07-20 07:11:44,151 DEBUG [rs(jenkins-hbase4.apache.org,44777,1689837020621)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,1,1689837103416.e4d8af6d8f4af1788629d227b0d2d3e6.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 07:11:44,151 DEBUG [rs(jenkins-hbase4.apache.org,45099,1689837020733)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1689837103416.7d2b0a3e96cd9a8c2702f7abb84fdddb. started... 2023-07-20 07:11:44,151 DEBUG [rs(jenkins-hbase4.apache.org,44777,1689837020621)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-20 07:11:44,151 DEBUG [rs(jenkins-hbase4.apache.org,44777,1689837020621)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-20 07:11:44,151 DEBUG [rs(jenkins-hbase4.apache.org,45099,1689837020733)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 7d2b0a3e96cd9a8c2702f7abb84fdddb: 2023-07-20 07:11:44,152 DEBUG [rs(jenkins-hbase4.apache.org,45099,1689837020733)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,,1689837103416.7d2b0a3e96cd9a8c2702f7abb84fdddb.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 07:11:44,152 DEBUG [rs(jenkins-hbase4.apache.org,45099,1689837020733)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-20 07:11:44,152 DEBUG [rs(jenkins-hbase4.apache.org,45099,1689837020733)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-20 07:11:44,158 DEBUG [member: 'jenkins-hbase4.apache.org,44955,1689837020792' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-20 07:11:44,158 DEBUG [member: 'jenkins-hbase4.apache.org,44955,1689837020792' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-20 07:11:44,158 DEBUG [member: 'jenkins-hbase4.apache.org,44955,1689837020792' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-20 07:11:44,181 DEBUG [rs(jenkins-hbase4.apache.org,45099,1689837020733)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1689837103416.7d2b0a3e96cd9a8c2702f7abb84fdddb. completed. 2023-07-20 07:11:44,181 DEBUG [rs(jenkins-hbase4.apache.org,45099,1689837020733)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1689837103416.7d2b0a3e96cd9a8c2702f7abb84fdddb. 2023-07-20 07:11:44,181 DEBUG [member: 'jenkins-hbase4.apache.org,45099,1689837020733' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-20 07:11:44,181 DEBUG [member: 'jenkins-hbase4.apache.org,45099,1689837020733' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-20 07:11:44,181 DEBUG [member: 'jenkins-hbase4.apache.org,45099,1689837020733' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,45099,1689837020733 2023-07-20 07:11:44,181 DEBUG [member: 'jenkins-hbase4.apache.org,45099,1689837020733' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-20 07:11:44,181 DEBUG [member: 'jenkins-hbase4.apache.org,45099,1689837020733' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,45099,1689837020733' in zk 2023-07-20 07:11:44,183 DEBUG [rs(jenkins-hbase4.apache.org,44777,1689837020621)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1689837103416.e4d8af6d8f4af1788629d227b0d2d3e6. completed. 2023-07-20 07:11:44,183 DEBUG [rs(jenkins-hbase4.apache.org,44777,1689837020621)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1689837103416.e4d8af6d8f4af1788629d227b0d2d3e6. 2023-07-20 07:11:44,183 DEBUG [member: 'jenkins-hbase4.apache.org,44777,1689837020621' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-20 07:11:44,183 DEBUG [member: 'jenkins-hbase4.apache.org,44777,1689837020621' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-20 07:11:44,183 DEBUG [member: 'jenkins-hbase4.apache.org,44777,1689837020621' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,44777,1689837020621 2023-07-20 07:11:44,183 DEBUG [member: 'jenkins-hbase4.apache.org,44777,1689837020621' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-20 07:11:44,183 DEBUG [member: 'jenkins-hbase4.apache.org,45099,1689837020733' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-20 07:11:44,183 DEBUG [member: 'jenkins-hbase4.apache.org,44777,1689837020621' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,44777,1689837020621' in zk 2023-07-20 07:11:44,183 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): master:37415-0x10181911f0f0000, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45099,1689837020733 2023-07-20 07:11:44,183 DEBUG [member: 'jenkins-hbase4.apache.org,45099,1689837020733' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-20 07:11:44,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45099,1689837020733 2023-07-20 07:11:44,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-20 07:11:44,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-20 07:11:44,184 DEBUG [member: 'jenkins-hbase4.apache.org,45099,1689837020733' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-20 07:11:44,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-20 07:11:44,186 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): master:37415-0x10181911f0f0000, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44777,1689837020621 2023-07-20 07:11:44,186 DEBUG [member: 'jenkins-hbase4.apache.org,44777,1689837020621' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-20 07:11:44,187 DEBUG [member: 'jenkins-hbase4.apache.org,44777,1689837020621' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-20 07:11:44,187 DEBUG [member: 'jenkins-hbase4.apache.org,44777,1689837020621' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-20 07:11:44,188 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-20 07:11:44,188 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 07:11:44,188 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44955,1689837020792 2023-07-20 07:11:44,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44777,1689837020621 2023-07-20 07:11:44,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45099,1689837020733 2023-07-20 07:11:44,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-20 07:11:44,190 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 07:11:44,190 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44955,1689837020792 2023-07-20 07:11:44,190 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44777,1689837020621 2023-07-20 07:11:44,190 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45099,1689837020733 2023-07-20 07:11:44,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,45099,1689837020733': 2023-07-20 07:11:44,191 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,45099,1689837020733' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 1 more 2023-07-20 07:11:44,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44777,1689837020621 2023-07-20 07:11:44,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-20 07:11:44,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-20 07:11:44,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-20 07:11:44,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-20 07:11:44,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 07:11:44,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44955,1689837020792 2023-07-20 07:11:44,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44777,1689837020621 2023-07-20 07:11:44,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45099,1689837020733 2023-07-20 07:11:44,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-20 07:11:44,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 07:11:44,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44955,1689837020792 2023-07-20 07:11:44,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44777,1689837020621 2023-07-20 07:11:44,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45099,1689837020733 2023-07-20 07:11:44,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,44777,1689837020621': 2023-07-20 07:11:44,197 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44777,1689837020621' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 0 more 2023-07-20 07:11:44,197 INFO [(jenkins-hbase4.apache.org,37415,1689837019114)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' execution completed 2023-07-20 07:11:44,197 DEBUG [(jenkins-hbase4.apache.org,37415,1689837019114)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-20 07:11:44,197 DEBUG [(jenkins-hbase4.apache.org,37415,1689837019114)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-20 07:11:44,198 DEBUG [(jenkins-hbase4.apache.org,37415,1689837019114)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 07:11:44,198 INFO [(jenkins-hbase4.apache.org,37415,1689837019114)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateWithMergeRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-20 07:11:44,200 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): regionserver:44777-0x10181911f0f0001, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 07:11:44,200 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): regionserver:45099-0x10181911f0f0002, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 07:11:44,200 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): regionserver:44955-0x10181911f0f0003, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 07:11:44,201 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 07:11:44,201 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 07:11:44,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 07:11:44,201 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): regionserver:45099-0x10181911f0f0002, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 07:11:44,201 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 07:11:44,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 07:11:44,201 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): master:37415-0x10181911f0f0000, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 07:11:44,200 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): regionserver:44777-0x10181911f0f0001, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 07:11:44,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 07:11:44,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-20 07:11:44,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-20 07:11:44,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 07:11:44,201 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): regionserver:44955-0x10181911f0f0003, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 07:11:44,202 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 07:11:44,202 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 07:11:44,202 DEBUG [(jenkins-hbase4.apache.org,37415,1689837019114)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37415-0x10181911f0f0000, quorum=127.0.0.1:58010, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44955,1689837020792 2023-07-20 07:11:44,202 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-20 07:11:44,202 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 07:11:44,202 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 07:11:44,202 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 07:11:44,202 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 07:11:44,203 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 07:11:44,203 DEBUG [(jenkins-hbase4.apache.org,37415,1689837019114)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37415-0x10181911f0f0000, quorum=127.0.0.1:58010, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44777,1689837020621 2023-07-20 07:11:44,203 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 07:11:44,203 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 07:11:44,203 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 07:11:44,203 DEBUG [(jenkins-hbase4.apache.org,37415,1689837019114)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37415-0x10181911f0f0000, quorum=127.0.0.1:58010, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45099,1689837020733 2023-07-20 07:11:44,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-20 07:11:44,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 07:11:44,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44955,1689837020792 2023-07-20 07:11:44,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44777,1689837020621 2023-07-20 07:11:44,206 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45099,1689837020733 2023-07-20 07:11:44,206 DEBUG [(jenkins-hbase4.apache.org,37415,1689837019114)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37415-0x10181911f0f0000, quorum=127.0.0.1:58010, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44955,1689837020792 2023-07-20 07:11:44,206 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-20 07:11:44,206 DEBUG [(jenkins-hbase4.apache.org,37415,1689837019114)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37415-0x10181911f0f0000, quorum=127.0.0.1:58010, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44777,1689837020621 2023-07-20 07:11:44,206 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 07:11:44,207 DEBUG [(jenkins-hbase4.apache.org,37415,1689837019114)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37415-0x10181911f0f0000, quorum=127.0.0.1:58010, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45099,1689837020733 2023-07-20 07:11:44,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44955,1689837020792 2023-07-20 07:11:44,207 DEBUG [Listener at jenkins-hbase4.apache.org/33837] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-20 07:11:44,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44777,1689837020621 2023-07-20 07:11:44,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45099,1689837020733 2023-07-20 07:11:44,208 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-20 07:11:44,208 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-20 07:11:44,209 DEBUG [Listener at jenkins-hbase4.apache.org/33837] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-20 07:11:44,211 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): regionserver:45099-0x10181911f0f0002, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 07:11:44,211 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): regionserver:44777-0x10181911f0f0001, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 07:11:44,211 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 07:11:44,211 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 07:11:44,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 07:11:44,212 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): master:37415-0x10181911f0f0000, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45099,1689837020733 2023-07-20 07:11:44,211 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): regionserver:44955-0x10181911f0f0003, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 07:11:44,211 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): regionserver:44777-0x10181911f0f0001, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 07:11:44,212 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): regionserver:44955-0x10181911f0f0003, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 07:11:44,212 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): master:37415-0x10181911f0f0000, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 07:11:44,212 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): regionserver:45099-0x10181911f0f0002, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 07:11:44,212 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 07:11:44,212 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): master:37415-0x10181911f0f0000, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44777,1689837020621 2023-07-20 07:11:44,212 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 07:11:44,212 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 07:11:44,212 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 07:11:44,212 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithMergeRegion 2023-07-20 07:11:44,212 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 07:11:44,212 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 07:11:44,212 DEBUG [(jenkins-hbase4.apache.org,37415,1689837019114)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-20 07:11:44,212 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => aaca68e56e63a701f5c1ec9dc2f0511c, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,.mob,0.aaca68e56e63a701f5c1ec9dc2f0511c.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 07:11:44,212 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): master:37415-0x10181911f0f0000, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44955,1689837020792 2023-07-20 07:11:44,213 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-20 07:11:44,214 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 07:11:44,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 07:11:44,215 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 07:11:44,214 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): master:37415-0x10181911f0f0000, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 07:11:44,215 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): master:37415-0x10181911f0f0000, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45099,1689837020733 2023-07-20 07:11:44,215 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): master:37415-0x10181911f0f0000, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 07:11:44,215 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): master:37415-0x10181911f0f0000, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44777,1689837020621 2023-07-20 07:11:44,215 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): master:37415-0x10181911f0f0000, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44955,1689837020792 2023-07-20 07:11:44,215 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): master:37415-0x10181911f0f0000, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 07:11:44,215 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): master:37415-0x10181911f0f0000, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 07:11:44,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 07:11:44,215 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-07-20 07:11:44,229 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 07:11:44,230 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 07:11:44,262 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion to hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/.hbase-snapshot/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 07:11:44,334 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed 2023-07-20 07:11:44,334 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 07:11:44,335 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 07:11:44,335 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion at 1689837104104Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithMergeRegion at 1689837104229 (+125 ms)Consolidate snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1689837104229Loading Region manifests for emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1689837104229Writing data manifest for emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1689837104242 (+13 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1689837104255 (+13 ms)Snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed at 1689837104334 (+79 ms) 2023-07-20 07:11:44,338 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=63, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-20 07:11:44,339 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=63, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED in 232 msec 2023-07-20 07:11:44,409 DEBUG [Listener at jenkins-hbase4.apache.org/33837] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-20 07:11:44,411 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-20 07:11:44,411 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-20 07:11:44,414 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45099] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithMergeRegion,,1689837103416.7d2b0a3e96cd9a8c2702f7abb84fdddb. with WAL disabled. Data may be lost in the event of a crash. 2023-07-20 07:11:44,415 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44777] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithMergeRegion,1,1689837103416.e4d8af6d8f4af1788629d227b0d2d3e6. with WAL disabled. Data may be lost in the event of a crash. 2023-07-20 07:11:44,418 DEBUG [Listener at jenkins-hbase4.apache.org/33837] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithMergeRegion 2023-07-20 07:11:44,419 DEBUG [Listener at jenkins-hbase4.apache.org/33837] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithMergeRegion,,1689837103416.7d2b0a3e96cd9a8c2702f7abb84fdddb. 2023-07-20 07:11:44,419 INFO [Listener at jenkins-hbase4.apache.org/33837] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-20 07:11:44,430 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-20 07:11:44,430 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689837104430 (current time:1689837104430). 2023-07-20 07:11:44,430 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-20 07:11:44,431 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] zookeeper.ReadOnlyZKClient(139): Connect 0x67cc33f3 to 127.0.0.1:58010 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-20 07:11:44,438 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@e3ae518, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-20 07:11:44,439 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-20 07:11:44,443 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:34230, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-20 07:11:44,444 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x67cc33f3 to 127.0.0.1:58010 2023-07-20 07:11:44,444 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-20 07:11:44,445 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] zookeeper.ReadOnlyZKClient(139): Connect 0x40174cac to 127.0.0.1:58010 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-20 07:11:44,450 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4642acf6, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-20 07:11:44,452 DEBUG [hconnection-0x1f098303-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-20 07:11:44,455 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:34244, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-20 07:11:44,460 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-20 07:11:44,463 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:44846, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-20 07:11:44,464 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x40174cac to 127.0.0.1:58010 2023-07-20 07:11:44,464 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-20 07:11:44,465 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-07-20 07:11:44,465 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-20 07:11:44,466 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-20 07:11:44,468 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] procedure2.ProcedureExecutor(1029): Stored pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-20 07:11:44,469 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-20 07:11:44,470 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=64, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE; timeout=600000, timestamp=1689837704470 2023-07-20 07:11:44,470 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-20 07:11:44,470 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion 2023-07-20 07:11:44,471 DEBUG [Listener at jenkins-hbase4.apache.org/33837] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-20 07:11:44,471 DEBUG [Listener at jenkins-hbase4.apache.org/33837] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-20 07:11:44,472 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=64, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-20 07:11:44,473 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=65, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-20 07:11:44,474 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=64, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE in 5 msec 2023-07-20 07:11:44,475 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=65, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-20 07:11:44,475 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=65, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED; timeout=600000, timestamp=1689837704475 2023-07-20 07:11:44,487 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 07:11:44,487 INFO [(jenkins-hbase4.apache.org,37415,1689837019114)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' 2023-07-20 07:11:44,487 DEBUG [(jenkins-hbase4.apache.org,37415,1689837019114)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-20 07:11:44,489 DEBUG [(jenkins-hbase4.apache.org,37415,1689837019114)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' 2023-07-20 07:11:44,489 DEBUG [(jenkins-hbase4.apache.org,37415,1689837019114)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion', kicking off acquire phase on members. 2023-07-20 07:11:44,490 DEBUG [(jenkins-hbase4.apache.org,37415,1689837019114)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37415-0x10181911f0f0000, quorum=127.0.0.1:58010, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 07:11:44,490 DEBUG [(jenkins-hbase4.apache.org,37415,1689837019114)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 07:11:44,493 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): regionserver:44955-0x10181911f0f0003, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 07:11:44,493 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): regionserver:44777-0x10181911f0f0001, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 07:11:44,493 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 07:11:44,493 DEBUG [(jenkins-hbase4.apache.org,37415,1689837019114)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44777,1689837020621 2023-07-20 07:11:44,493 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): regionserver:45099-0x10181911f0f0002, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 07:11:44,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 07:11:44,493 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 07:11:44,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 07:11:44,493 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 07:11:44,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 07:11:44,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 07:11:44,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 07:11:44,494 DEBUG [(jenkins-hbase4.apache.org,37415,1689837019114)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37415-0x10181911f0f0000, quorum=127.0.0.1:58010, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44777,1689837020621 2023-07-20 07:11:44,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 07:11:44,494 DEBUG [(jenkins-hbase4.apache.org,37415,1689837019114)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45099,1689837020733 2023-07-20 07:11:44,494 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45099-0x10181911f0f0002, quorum=127.0.0.1:58010, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 07:11:44,494 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44955-0x10181911f0f0003, quorum=127.0.0.1:58010, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 07:11:44,494 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44777-0x10181911f0f0001, quorum=127.0.0.1:58010, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 07:11:44,494 DEBUG [(jenkins-hbase4.apache.org,37415,1689837019114)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37415-0x10181911f0f0000, quorum=127.0.0.1:58010, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45099,1689837020733 2023-07-20 07:11:44,494 DEBUG [(jenkins-hbase4.apache.org,37415,1689837019114)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-20 07:11:44,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-07-20 07:11:44,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 07:11:44,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-07-20 07:11:44,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 07:11:44,495 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-20 07:11:44,495 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-20 07:11:44,495 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 07:11:44,495 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 07:11:44,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-07-20 07:11:44,495 DEBUG [member: 'jenkins-hbase4.apache.org,44955,1689837020792' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-20 07:11:44,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 07:11:44,495 DEBUG [member: 'jenkins-hbase4.apache.org,45099,1689837020733' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-20 07:11:44,495 DEBUG [member: 'jenkins-hbase4.apache.org,45099,1689837020733' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-20 07:11:44,495 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-20 07:11:44,495 DEBUG [member: 'jenkins-hbase4.apache.org,44955,1689837020792' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-20 07:11:44,497 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 07:11:44,497 DEBUG [member: 'jenkins-hbase4.apache.org,45099,1689837020733' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-20 07:11:44,498 DEBUG [member: 'jenkins-hbase4.apache.org,45099,1689837020733' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-20 07:11:44,498 DEBUG [member: 'jenkins-hbase4.apache.org,45099,1689837020733' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45099,1689837020733' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-20 07:11:44,499 DEBUG [member: 'jenkins-hbase4.apache.org,44955,1689837020792' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-20 07:11:44,499 DEBUG [member: 'jenkins-hbase4.apache.org,44955,1689837020792' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-20 07:11:44,499 DEBUG [member: 'jenkins-hbase4.apache.org,44955,1689837020792' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44955,1689837020792' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-20 07:11:44,500 DEBUG [member: 'jenkins-hbase4.apache.org,44777,1689837020621' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-20 07:11:44,500 DEBUG [member: 'jenkins-hbase4.apache.org,44777,1689837020621' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-20 07:11:44,501 DEBUG [member: 'jenkins-hbase4.apache.org,44777,1689837020621' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-20 07:11:44,501 DEBUG [member: 'jenkins-hbase4.apache.org,44777,1689837020621' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-20 07:11:44,501 DEBUG [member: 'jenkins-hbase4.apache.org,44777,1689837020621' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44777,1689837020621' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-20 07:11:44,503 DEBUG [member: 'jenkins-hbase4.apache.org,44955,1689837020792' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 07:11:44,504 DEBUG [member: 'jenkins-hbase4.apache.org,44955,1689837020792' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44955-0x10181911f0f0003, quorum=127.0.0.1:58010, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 07:11:44,504 DEBUG [member: 'jenkins-hbase4.apache.org,44955,1689837020792' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-20 07:11:44,504 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): master:37415-0x10181911f0f0000, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45099,1689837020733 2023-07-20 07:11:44,505 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45099,1689837020733 2023-07-20 07:11:44,505 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-20 07:11:44,505 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-20 07:11:44,506 DEBUG [member: 'jenkins-hbase4.apache.org,45099,1689837020733' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 07:11:44,509 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): master:37415-0x10181911f0f0000, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44777,1689837020621 2023-07-20 07:11:44,509 DEBUG [member: 'jenkins-hbase4.apache.org,44777,1689837020621' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 07:11:44,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-20 07:11:44,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-20 07:11:44,509 DEBUG [member: 'jenkins-hbase4.apache.org,44777,1689837020621' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44777-0x10181911f0f0001, quorum=127.0.0.1:58010, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 07:11:44,510 DEBUG [member: 'jenkins-hbase4.apache.org,44777,1689837020621' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-20 07:11:44,510 DEBUG [member: 'jenkins-hbase4.apache.org,45099,1689837020733' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45099-0x10181911f0f0002, quorum=127.0.0.1:58010, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 07:11:44,510 DEBUG [member: 'jenkins-hbase4.apache.org,45099,1689837020733' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-20 07:11:44,510 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 07:11:44,510 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44955,1689837020792 2023-07-20 07:11:44,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44777,1689837020621 2023-07-20 07:11:44,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45099,1689837020733 2023-07-20 07:11:44,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-20 07:11:44,512 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,45099,1689837020733' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-07-20 07:11:44,512 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4e6fe280[Count = 1] remaining members to acquire global barrier 2023-07-20 07:11:44,512 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44777,1689837020621 2023-07-20 07:11:44,512 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-20 07:11:44,512 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-20 07:11:44,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-20 07:11:44,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-20 07:11:44,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 07:11:44,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44955,1689837020792 2023-07-20 07:11:44,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44777,1689837020621 2023-07-20 07:11:44,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45099,1689837020733 2023-07-20 07:11:44,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-20 07:11:44,515 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44777,1689837020621' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-07-20 07:11:44,515 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4e6fe280[Count = 0] remaining members to acquire global barrier 2023-07-20 07:11:44,515 DEBUG [(jenkins-hbase4.apache.org,37415,1689837019114)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'in-barrier' execution. 2023-07-20 07:11:44,516 DEBUG [(jenkins-hbase4.apache.org,37415,1689837019114)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 07:11:44,517 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): regionserver:45099-0x10181911f0f0002, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 07:11:44,517 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): regionserver:44777-0x10181911f0f0001, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 07:11:44,517 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): regionserver:44955-0x10181911f0f0003, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 07:11:44,517 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 07:11:44,517 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 07:11:44,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 07:11:44,517 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 07:11:44,517 DEBUG [(jenkins-hbase4.apache.org,37415,1689837019114)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37415-0x10181911f0f0000, quorum=127.0.0.1:58010, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45099,1689837020733 2023-07-20 07:11:44,517 DEBUG [member: 'jenkins-hbase4.apache.org,44955,1689837020792' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-20 07:11:44,517 DEBUG [member: 'jenkins-hbase4.apache.org,44955,1689837020792' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-20 07:11:44,517 DEBUG [member: 'jenkins-hbase4.apache.org,44955,1689837020792' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,44955,1689837020792' in zk 2023-07-20 07:11:44,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 07:11:44,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 07:11:44,518 DEBUG [member: 'jenkins-hbase4.apache.org,44777,1689837020621' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-20 07:11:44,518 DEBUG [member: 'jenkins-hbase4.apache.org,45099,1689837020733' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-20 07:11:44,518 DEBUG [member: 'jenkins-hbase4.apache.org,44777,1689837020621' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-20 07:11:44,518 DEBUG [member: 'jenkins-hbase4.apache.org,44777,1689837020621' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-20 07:11:44,518 DEBUG [rs(jenkins-hbase4.apache.org,44777,1689837020621)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1689837103416.e4d8af6d8f4af1788629d227b0d2d3e6. 2023-07-20 07:11:44,518 DEBUG [member: 'jenkins-hbase4.apache.org,45099,1689837020733' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-20 07:11:44,518 DEBUG [member: 'jenkins-hbase4.apache.org,45099,1689837020733' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-20 07:11:44,518 DEBUG [rs(jenkins-hbase4.apache.org,44777,1689837020621)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1689837103416.e4d8af6d8f4af1788629d227b0d2d3e6. started... 2023-07-20 07:11:44,518 DEBUG [(jenkins-hbase4.apache.org,37415,1689837019114)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37415-0x10181911f0f0000, quorum=127.0.0.1:58010, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44777,1689837020621 2023-07-20 07:11:44,518 DEBUG [rs(jenkins-hbase4.apache.org,45099,1689837020733)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1689837103416.7d2b0a3e96cd9a8c2702f7abb84fdddb. 2023-07-20 07:11:44,518 DEBUG [(jenkins-hbase4.apache.org,37415,1689837019114)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-20 07:11:44,518 DEBUG [rs(jenkins-hbase4.apache.org,45099,1689837020733)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1689837103416.7d2b0a3e96cd9a8c2702f7abb84fdddb. started... 2023-07-20 07:11:44,518 INFO [rs(jenkins-hbase4.apache.org,44777,1689837020621)-snapshot-pool-0] regionserver.HRegion(2745): Flushing e4d8af6d8f4af1788629d227b0d2d3e6 1/1 column families, dataSize=2.80 KB heapSize=6.30 KB 2023-07-20 07:11:44,519 INFO [rs(jenkins-hbase4.apache.org,45099,1689837020733)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 7d2b0a3e96cd9a8c2702f7abb84fdddb 1/1 column families, dataSize=467 B heapSize=1.23 KB 2023-07-20 07:11:44,519 DEBUG [member: 'jenkins-hbase4.apache.org,44955,1689837020792' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-20 07:11:44,519 DEBUG [member: 'jenkins-hbase4.apache.org,44955,1689837020792' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-20 07:11:44,519 DEBUG [member: 'jenkins-hbase4.apache.org,44955,1689837020792' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-20 07:11:44,572 DEBUG [Listener at jenkins-hbase4.apache.org/33837] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-20 07:11:44,581 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-20 07:11:44,581 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-20 07:11:44,581 DEBUG [Listener at jenkins-hbase4.apache.org/33837] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-20 07:11:44,603 INFO [rs(jenkins-hbase4.apache.org,45099,1689837020733)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202307201bc4454c4f37429db8fe3682beba7cc4 to hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e202307201bc4454c4f37429db8fe3682beba7cc4 2023-07-20 07:11:44,632 INFO [rs(jenkins-hbase4.apache.org,44777,1689837020621)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023072076c080b256b1462f83b05a08e0e6cd47 to hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b2023072076c080b256b1462f83b05a08e0e6cd47 2023-07-20 07:11:44,647 INFO [rs(jenkins-hbase4.apache.org,45099,1689837020733)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=467, hasBloomFilter=true, into tmp file hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/data/default/testtb-testExportFileSystemStateWithMergeRegion/7d2b0a3e96cd9a8c2702f7abb84fdddb/.tmp/cf/fe36267d88204b33a44d6481310ecf6c 2023-07-20 07:11:44,657 DEBUG [rs(jenkins-hbase4.apache.org,45099,1689837020733)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/data/default/testtb-testExportFileSystemStateWithMergeRegion/7d2b0a3e96cd9a8c2702f7abb84fdddb/.tmp/cf/fe36267d88204b33a44d6481310ecf6c as hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/data/default/testtb-testExportFileSystemStateWithMergeRegion/7d2b0a3e96cd9a8c2702f7abb84fdddb/cf/fe36267d88204b33a44d6481310ecf6c 2023-07-20 07:11:44,663 INFO [rs(jenkins-hbase4.apache.org,45099,1689837020733)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/data/default/testtb-testExportFileSystemStateWithMergeRegion/7d2b0a3e96cd9a8c2702f7abb84fdddb/cf/fe36267d88204b33a44d6481310ecf6c, entries=7, sequenceid=6, filesize=6.2 K 2023-07-20 07:11:44,665 INFO [rs(jenkins-hbase4.apache.org,45099,1689837020733)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~467 B/467, heapSize ~1.22 KB/1248, currentSize=0 B/0 for 7d2b0a3e96cd9a8c2702f7abb84fdddb in 147ms, sequenceid=6, compaction requested=false 2023-07-20 07:11:44,665 DEBUG [rs(jenkins-hbase4.apache.org,45099,1689837020733)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithMergeRegion' 2023-07-20 07:11:44,665 DEBUG [rs(jenkins-hbase4.apache.org,45099,1689837020733)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 7d2b0a3e96cd9a8c2702f7abb84fdddb: 2023-07-20 07:11:44,666 DEBUG [rs(jenkins-hbase4.apache.org,45099,1689837020733)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,,1689837103416.7d2b0a3e96cd9a8c2702f7abb84fdddb.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 07:11:44,666 DEBUG [rs(jenkins-hbase4.apache.org,45099,1689837020733)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-20 07:11:44,666 DEBUG [rs(jenkins-hbase4.apache.org,45099,1689837020733)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/data/default/testtb-testExportFileSystemStateWithMergeRegion/7d2b0a3e96cd9a8c2702f7abb84fdddb/cf/fe36267d88204b33a44d6481310ecf6c] hfiles 2023-07-20 07:11:44,666 DEBUG [rs(jenkins-hbase4.apache.org,45099,1689837020733)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/data/default/testtb-testExportFileSystemStateWithMergeRegion/7d2b0a3e96cd9a8c2702f7abb84fdddb/cf/fe36267d88204b33a44d6481310ecf6c for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 07:11:44,669 INFO [rs(jenkins-hbase4.apache.org,44777,1689837020621)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=2.8 K, hasBloomFilter=true, into tmp file hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/data/default/testtb-testExportFileSystemStateWithMergeRegion/e4d8af6d8f4af1788629d227b0d2d3e6/.tmp/cf/ef13dd536f7b4fafacbc8298917ffe69 2023-07-20 07:11:44,711 DEBUG [rs(jenkins-hbase4.apache.org,44777,1689837020621)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/data/default/testtb-testExportFileSystemStateWithMergeRegion/e4d8af6d8f4af1788629d227b0d2d3e6/.tmp/cf/ef13dd536f7b4fafacbc8298917ffe69 as hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/data/default/testtb-testExportFileSystemStateWithMergeRegion/e4d8af6d8f4af1788629d227b0d2d3e6/cf/ef13dd536f7b4fafacbc8298917ffe69 2023-07-20 07:11:44,720 INFO [rs(jenkins-hbase4.apache.org,44777,1689837020621)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/data/default/testtb-testExportFileSystemStateWithMergeRegion/e4d8af6d8f4af1788629d227b0d2d3e6/cf/ef13dd536f7b4fafacbc8298917ffe69, entries=43, sequenceid=6, filesize=12.8 K 2023-07-20 07:11:44,721 INFO [rs(jenkins-hbase4.apache.org,44777,1689837020621)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~2.80 KB/2869, heapSize ~6.28 KB/6432, currentSize=0 B/0 for e4d8af6d8f4af1788629d227b0d2d3e6 in 203ms, sequenceid=6, compaction requested=false 2023-07-20 07:11:44,724 DEBUG [rs(jenkins-hbase4.apache.org,44777,1689837020621)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for e4d8af6d8f4af1788629d227b0d2d3e6: 2023-07-20 07:11:44,724 DEBUG [rs(jenkins-hbase4.apache.org,44777,1689837020621)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,1,1689837103416.e4d8af6d8f4af1788629d227b0d2d3e6.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 07:11:44,724 DEBUG [rs(jenkins-hbase4.apache.org,44777,1689837020621)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-20 07:11:44,724 DEBUG [rs(jenkins-hbase4.apache.org,44777,1689837020621)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/data/default/testtb-testExportFileSystemStateWithMergeRegion/e4d8af6d8f4af1788629d227b0d2d3e6/cf/ef13dd536f7b4fafacbc8298917ffe69] hfiles 2023-07-20 07:11:44,724 DEBUG [rs(jenkins-hbase4.apache.org,44777,1689837020621)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/data/default/testtb-testExportFileSystemStateWithMergeRegion/e4d8af6d8f4af1788629d227b0d2d3e6/cf/ef13dd536f7b4fafacbc8298917ffe69 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 07:11:44,736 DEBUG [rs(jenkins-hbase4.apache.org,45099,1689837020733)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1689837103416.7d2b0a3e96cd9a8c2702f7abb84fdddb. completed. 2023-07-20 07:11:44,736 DEBUG [rs(jenkins-hbase4.apache.org,45099,1689837020733)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1689837103416.7d2b0a3e96cd9a8c2702f7abb84fdddb. 2023-07-20 07:11:44,736 DEBUG [member: 'jenkins-hbase4.apache.org,45099,1689837020733' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-20 07:11:44,736 DEBUG [member: 'jenkins-hbase4.apache.org,45099,1689837020733' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-20 07:11:44,736 DEBUG [member: 'jenkins-hbase4.apache.org,45099,1689837020733' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,45099,1689837020733 2023-07-20 07:11:44,736 DEBUG [member: 'jenkins-hbase4.apache.org,45099,1689837020733' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-20 07:11:44,736 DEBUG [member: 'jenkins-hbase4.apache.org,45099,1689837020733' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,45099,1689837020733' in zk 2023-07-20 07:11:44,738 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): master:37415-0x10181911f0f0000, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45099,1689837020733 2023-07-20 07:11:44,738 DEBUG [member: 'jenkins-hbase4.apache.org,45099,1689837020733' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-20 07:11:44,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45099,1689837020733 2023-07-20 07:11:44,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-20 07:11:44,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-20 07:11:44,738 DEBUG [member: 'jenkins-hbase4.apache.org,45099,1689837020733' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-20 07:11:44,738 DEBUG [member: 'jenkins-hbase4.apache.org,45099,1689837020733' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-20 07:11:44,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-20 07:11:44,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-20 07:11:44,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 07:11:44,740 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44955,1689837020792 2023-07-20 07:11:44,740 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44777,1689837020621 2023-07-20 07:11:44,740 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45099,1689837020733 2023-07-20 07:11:44,741 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-20 07:11:44,741 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 07:11:44,744 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44955,1689837020792 2023-07-20 07:11:44,744 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45099,1689837020733 2023-07-20 07:11:44,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,45099,1689837020733': 2023-07-20 07:11:44,745 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,45099,1689837020733' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 1 more 2023-07-20 07:11:44,779 DEBUG [rs(jenkins-hbase4.apache.org,44777,1689837020621)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1689837103416.e4d8af6d8f4af1788629d227b0d2d3e6. completed. 2023-07-20 07:11:44,779 DEBUG [rs(jenkins-hbase4.apache.org,44777,1689837020621)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1689837103416.e4d8af6d8f4af1788629d227b0d2d3e6. 2023-07-20 07:11:44,780 DEBUG [member: 'jenkins-hbase4.apache.org,44777,1689837020621' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-20 07:11:44,780 DEBUG [member: 'jenkins-hbase4.apache.org,44777,1689837020621' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-20 07:11:44,780 DEBUG [member: 'jenkins-hbase4.apache.org,44777,1689837020621' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,44777,1689837020621 2023-07-20 07:11:44,780 DEBUG [member: 'jenkins-hbase4.apache.org,44777,1689837020621' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-20 07:11:44,780 DEBUG [member: 'jenkins-hbase4.apache.org,44777,1689837020621' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,44777,1689837020621' in zk 2023-07-20 07:11:44,781 DEBUG [Listener at jenkins-hbase4.apache.org/33837] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-20 07:11:44,782 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-20 07:11:44,782 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-20 07:11:44,783 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): master:37415-0x10181911f0f0000, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44777,1689837020621 2023-07-20 07:11:44,783 DEBUG [member: 'jenkins-hbase4.apache.org,44777,1689837020621' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-20 07:11:44,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44777,1689837020621 2023-07-20 07:11:44,783 DEBUG [member: 'jenkins-hbase4.apache.org,44777,1689837020621' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-20 07:11:44,783 DEBUG [Listener at jenkins-hbase4.apache.org/33837] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-20 07:11:44,783 DEBUG [member: 'jenkins-hbase4.apache.org,44777,1689837020621' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-20 07:11:44,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-20 07:11:44,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-20 07:11:44,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-20 07:11:44,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-20 07:11:44,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 07:11:44,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44955,1689837020792 2023-07-20 07:11:44,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44777,1689837020621 2023-07-20 07:11:44,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45099,1689837020733 2023-07-20 07:11:44,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-20 07:11:44,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 07:11:44,789 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44955,1689837020792 2023-07-20 07:11:44,789 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44777,1689837020621 2023-07-20 07:11:44,789 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45099,1689837020733 2023-07-20 07:11:44,790 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,44777,1689837020621': 2023-07-20 07:11:44,790 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44777,1689837020621' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 0 more 2023-07-20 07:11:44,790 INFO [(jenkins-hbase4.apache.org,37415,1689837019114)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' execution completed 2023-07-20 07:11:44,790 DEBUG [(jenkins-hbase4.apache.org,37415,1689837019114)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-20 07:11:44,790 DEBUG [(jenkins-hbase4.apache.org,37415,1689837019114)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-20 07:11:44,790 DEBUG [(jenkins-hbase4.apache.org,37415,1689837019114)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 07:11:44,790 INFO [(jenkins-hbase4.apache.org,37415,1689837019114)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithMergeRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-20 07:11:44,797 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): regionserver:45099-0x10181911f0f0002, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 07:11:44,797 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): regionserver:45099-0x10181911f0f0002, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 07:11:44,797 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 07:11:44,798 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 07:11:44,798 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): master:37415-0x10181911f0f0000, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 07:11:44,798 DEBUG [(jenkins-hbase4.apache.org,37415,1689837019114)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37415-0x10181911f0f0000, quorum=127.0.0.1:58010, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44955,1689837020792 2023-07-20 07:11:44,798 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 07:11:44,798 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-20 07:11:44,798 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-20 07:11:44,798 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): regionserver:44777-0x10181911f0f0001, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 07:11:44,798 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): regionserver:44955-0x10181911f0f0003, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 07:11:44,799 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): regionserver:44955-0x10181911f0f0003, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 07:11:44,799 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 07:11:44,799 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 07:11:44,799 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): regionserver:44777-0x10181911f0f0001, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 07:11:44,798 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 07:11:44,799 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 07:11:44,799 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 07:11:44,799 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 07:11:44,799 DEBUG [(jenkins-hbase4.apache.org,37415,1689837019114)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37415-0x10181911f0f0000, quorum=127.0.0.1:58010, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44777,1689837020621 2023-07-20 07:11:44,799 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-20 07:11:44,799 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 07:11:44,799 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 07:11:44,800 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 07:11:44,800 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 07:11:44,800 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 07:11:44,800 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 07:11:44,800 DEBUG [(jenkins-hbase4.apache.org,37415,1689837019114)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37415-0x10181911f0f0000, quorum=127.0.0.1:58010, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45099,1689837020733 2023-07-20 07:11:44,800 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 07:11:44,801 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 07:11:44,802 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-20 07:11:44,803 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 07:11:44,803 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44955,1689837020792 2023-07-20 07:11:44,804 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44777,1689837020621 2023-07-20 07:11:44,804 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45099,1689837020733 2023-07-20 07:11:44,804 DEBUG [(jenkins-hbase4.apache.org,37415,1689837019114)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37415-0x10181911f0f0000, quorum=127.0.0.1:58010, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44955,1689837020792 2023-07-20 07:11:44,804 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-20 07:11:44,805 DEBUG [(jenkins-hbase4.apache.org,37415,1689837019114)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37415-0x10181911f0f0000, quorum=127.0.0.1:58010, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44777,1689837020621 2023-07-20 07:11:44,805 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 07:11:44,806 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44955,1689837020792 2023-07-20 07:11:44,806 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44777,1689837020621 2023-07-20 07:11:44,807 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45099,1689837020733 2023-07-20 07:11:44,805 DEBUG [(jenkins-hbase4.apache.org,37415,1689837019114)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37415-0x10181911f0f0000, quorum=127.0.0.1:58010, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45099,1689837020733 2023-07-20 07:11:44,813 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): regionserver:45099-0x10181911f0f0002, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 07:11:44,813 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 07:11:44,813 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 07:11:44,813 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): regionserver:44777-0x10181911f0f0001, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 07:11:44,813 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): regionserver:44777-0x10181911f0f0001, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 07:11:44,813 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 07:11:44,813 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 07:11:44,813 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): regionserver:45099-0x10181911f0f0002, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 07:11:44,813 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): master:37415-0x10181911f0f0000, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45099,1689837020733 2023-07-20 07:11:44,813 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 07:11:44,813 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 07:11:44,813 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): master:37415-0x10181911f0f0000, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 07:11:44,813 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): master:37415-0x10181911f0f0000, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44777,1689837020621 2023-07-20 07:11:44,813 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 07:11:44,813 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 07:11:44,813 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): master:37415-0x10181911f0f0000, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44955,1689837020792 2023-07-20 07:11:44,813 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): master:37415-0x10181911f0f0000, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 07:11:44,814 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): master:37415-0x10181911f0f0000, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45099,1689837020733 2023-07-20 07:11:44,814 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): master:37415-0x10181911f0f0000, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 07:11:44,814 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): master:37415-0x10181911f0f0000, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44777,1689837020621 2023-07-20 07:11:44,814 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): master:37415-0x10181911f0f0000, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44955,1689837020792 2023-07-20 07:11:44,814 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): master:37415-0x10181911f0f0000, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 07:11:44,814 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): master:37415-0x10181911f0f0000, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 07:11:44,814 DEBUG [(jenkins-hbase4.apache.org,37415,1689837019114)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-20 07:11:44,814 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 07:11:44,814 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithMergeRegion 2023-07-20 07:11:44,814 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => aaca68e56e63a701f5c1ec9dc2f0511c, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,.mob,0.aaca68e56e63a701f5c1ec9dc2f0511c.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 07:11:44,814 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-20 07:11:44,816 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): regionserver:44955-0x10181911f0f0003, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 07:11:44,816 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): regionserver:44955-0x10181911f0f0003, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 07:11:44,816 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 07:11:44,816 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 07:11:44,817 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 07:11:44,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 07:11:44,817 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b2023072076c080b256b1462f83b05a08e0e6cd47, hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e202307201bc4454c4f37429db8fe3682beba7cc4] mob files 2023-07-20 07:11:44,817 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b2023072076c080b256b1462f83b05a08e0e6cd47 2023-07-20 07:11:44,817 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e202307201bc4454c4f37429db8fe3682beba7cc4 2023-07-20 07:11:44,845 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 07:11:44,846 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 07:11:44,897 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion to hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 07:11:44,930 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed 2023-07-20 07:11:44,930 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 07:11:44,931 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 07:11:44,931 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion at 1689837104470Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithMergeRegion at 1689837104845 (+375 ms)Consolidate snapshot: snaptb0-testExportFileSystemStateWithMergeRegion at 1689837104845Loading Region manifests for snaptb0-testExportFileSystemStateWithMergeRegion at 1689837104845Writing data manifest for snaptb0-testExportFileSystemStateWithMergeRegion at 1689837104855 (+10 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithMergeRegion at 1689837104887 (+32 ms)Snapshot snaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed at 1689837104930 (+43 ms) 2023-07-20 07:11:44,934 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=65, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-20 07:11:44,936 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=65, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED in 463 msec 2023-07-20 07:11:45,085 DEBUG [Listener at jenkins-hbase4.apache.org/33837] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-20 07:11:45,087 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-20 07:11:45,087 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-20 07:11:45,123 DEBUG [Listener at jenkins-hbase4.apache.org/33837] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-20 07:11:45,127 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:38434, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-20 07:11:45,130 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44777] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-07-20 07:11:45,131 DEBUG [Listener at jenkins-hbase4.apache.org/33837] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-20 07:11:45,135 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:44850, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-20 07:11:45,135 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44955] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-07-20 07:11:45,136 DEBUG [Listener at jenkins-hbase4.apache.org/33837] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-20 07:11:45,139 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:34254, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-20 07:11:45,139 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45099] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-07-20 07:11:45,142 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-20 07:11:45,143 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] procedure2.ProcedureExecutor(1029): Stored pid=66, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-20 07:11:45,145 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_PRE_OPERATION 2023-07-20 07:11:45,145 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithMergeRegion-1" procId is: 66 2023-07-20 07:11:45,146 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-20 07:11:45,146 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-20 07:11:45,148 DEBUG [HFileArchiver-17] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/77d7be86acc0ccac94456dd0a55825f4 2023-07-20 07:11:45,148 DEBUG [HFileArchiver-18] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/fd3a8893515b8e1a864055023aea9a27 2023-07-20 07:11:45,149 DEBUG [HFileArchiver-17] backup.HFileArchiver(153): Directory hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/77d7be86acc0ccac94456dd0a55825f4 empty. 2023-07-20 07:11:45,149 DEBUG [HFileArchiver-17] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/77d7be86acc0ccac94456dd0a55825f4 2023-07-20 07:11:45,154 DEBUG [HFileArchiver-18] backup.HFileArchiver(153): Directory hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/fd3a8893515b8e1a864055023aea9a27 empty. 2023-07-20 07:11:45,155 DEBUG [HFileArchiver-18] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/fd3a8893515b8e1a864055023aea9a27 2023-07-20 07:11:45,155 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion-1 regions 2023-07-20 07:11:45,177 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/.tabledesc/.tableinfo.0000000001 2023-07-20 07:11:45,178 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(7675): creating {ENCODED => 77d7be86acc0ccac94456dd0a55825f4, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1689837105141.77d7be86acc0ccac94456dd0a55825f4.', STARTKEY => '', ENDKEY => '2'}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/.tmp 2023-07-20 07:11:45,179 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(7675): creating {ENCODED => fd3a8893515b8e1a864055023aea9a27, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,2,1689837105141.fd3a8893515b8e1a864055023aea9a27.', STARTKEY => '2', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/.tmp 2023-07-20 07:11:45,198 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1689837105141.77d7be86acc0ccac94456dd0a55825f4.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-20 07:11:45,198 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1604): Closing 77d7be86acc0ccac94456dd0a55825f4, disabling compactions & flushes 2023-07-20 07:11:45,198 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1689837105141.77d7be86acc0ccac94456dd0a55825f4. 2023-07-20 07:11:45,198 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689837105141.77d7be86acc0ccac94456dd0a55825f4. 2023-07-20 07:11:45,198 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689837105141.77d7be86acc0ccac94456dd0a55825f4. after waiting 0 ms 2023-07-20 07:11:45,198 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1689837105141.77d7be86acc0ccac94456dd0a55825f4. 2023-07-20 07:11:45,198 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1689837105141.77d7be86acc0ccac94456dd0a55825f4. 2023-07-20 07:11:45,198 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1558): Region close journal for 77d7be86acc0ccac94456dd0a55825f4: 2023-07-20 07:11:45,200 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,2,1689837105141.fd3a8893515b8e1a864055023aea9a27.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-20 07:11:45,200 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1604): Closing fd3a8893515b8e1a864055023aea9a27, disabling compactions & flushes 2023-07-20 07:11:45,201 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,2,1689837105141.fd3a8893515b8e1a864055023aea9a27. 2023-07-20 07:11:45,201 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1689837105141.fd3a8893515b8e1a864055023aea9a27. 2023-07-20 07:11:45,201 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1689837105141.fd3a8893515b8e1a864055023aea9a27. after waiting 0 ms 2023-07-20 07:11:45,201 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,2,1689837105141.fd3a8893515b8e1a864055023aea9a27. 2023-07-20 07:11:45,201 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,2,1689837105141.fd3a8893515b8e1a864055023aea9a27. 2023-07-20 07:11:45,201 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1558): Region close journal for fd3a8893515b8e1a864055023aea9a27: 2023-07-20 07:11:45,203 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_ADD_TO_META 2023-07-20 07:11:45,204 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689837105141.77d7be86acc0ccac94456dd0a55825f4.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689837105204"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689837105204"}]},"ts":"1689837105204"} 2023-07-20 07:11:45,204 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689837105141.fd3a8893515b8e1a864055023aea9a27.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689837105204"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689837105204"}]},"ts":"1689837105204"} 2023-07-20 07:11:45,207 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-20 07:11:45,208 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-20 07:11:45,208 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689837105208"}]},"ts":"1689837105208"} 2023-07-20 07:11:45,209 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=ENABLING in hbase:meta 2023-07-20 07:11:45,212 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-20 07:11:45,214 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-20 07:11:45,214 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-20 07:11:45,214 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-20 07:11:45,214 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-20 07:11:45,214 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=77d7be86acc0ccac94456dd0a55825f4, ASSIGN}, {pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=fd3a8893515b8e1a864055023aea9a27, ASSIGN}] 2023-07-20 07:11:45,217 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=77d7be86acc0ccac94456dd0a55825f4, ASSIGN 2023-07-20 07:11:45,217 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=fd3a8893515b8e1a864055023aea9a27, ASSIGN 2023-07-20 07:11:45,218 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=77d7be86acc0ccac94456dd0a55825f4, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,44777,1689837020621; forceNewPlan=false, retain=false 2023-07-20 07:11:45,218 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=fd3a8893515b8e1a864055023aea9a27, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,44955,1689837020792; forceNewPlan=false, retain=false 2023-07-20 07:11:45,247 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-20 07:11:45,368 INFO [jenkins-hbase4:37415] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-20 07:11:45,371 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=77d7be86acc0ccac94456dd0a55825f4, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,44777,1689837020621 2023-07-20 07:11:45,371 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=68 updating hbase:meta row=fd3a8893515b8e1a864055023aea9a27, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,44955,1689837020792 2023-07-20 07:11:45,371 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689837105141.77d7be86acc0ccac94456dd0a55825f4.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689837105371"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689837105371"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689837105371"}]},"ts":"1689837105371"} 2023-07-20 07:11:45,372 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689837105141.fd3a8893515b8e1a864055023aea9a27.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689837105371"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689837105371"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689837105371"}]},"ts":"1689837105371"} 2023-07-20 07:11:45,373 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=69, ppid=67, state=RUNNABLE; OpenRegionProcedure 77d7be86acc0ccac94456dd0a55825f4, server=jenkins-hbase4.apache.org,44777,1689837020621}] 2023-07-20 07:11:45,379 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=70, ppid=68, state=RUNNABLE; OpenRegionProcedure fd3a8893515b8e1a864055023aea9a27, server=jenkins-hbase4.apache.org,44955,1689837020792}] 2023-07-20 07:11:45,449 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-20 07:11:45,533 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,2,1689837105141.fd3a8893515b8e1a864055023aea9a27. 2023-07-20 07:11:45,533 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => fd3a8893515b8e1a864055023aea9a27, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,2,1689837105141.fd3a8893515b8e1a864055023aea9a27.', STARTKEY => '2', ENDKEY => ''} 2023-07-20 07:11:45,534 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,,1689837105141.77d7be86acc0ccac94456dd0a55825f4. 2023-07-20 07:11:45,534 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,2,1689837105141.fd3a8893515b8e1a864055023aea9a27. service=AccessControlService 2023-07-20 07:11:45,534 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 77d7be86acc0ccac94456dd0a55825f4, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1689837105141.77d7be86acc0ccac94456dd0a55825f4.', STARTKEY => '', ENDKEY => '2'} 2023-07-20 07:11:45,534 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-20 07:11:45,534 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 fd3a8893515b8e1a864055023aea9a27 2023-07-20 07:11:45,534 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,2,1689837105141.fd3a8893515b8e1a864055023aea9a27.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-20 07:11:45,534 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for fd3a8893515b8e1a864055023aea9a27 2023-07-20 07:11:45,534 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for fd3a8893515b8e1a864055023aea9a27 2023-07-20 07:11:45,534 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,,1689837105141.77d7be86acc0ccac94456dd0a55825f4. service=AccessControlService 2023-07-20 07:11:45,535 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-20 07:11:45,535 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 77d7be86acc0ccac94456dd0a55825f4 2023-07-20 07:11:45,535 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1689837105141.77d7be86acc0ccac94456dd0a55825f4.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-20 07:11:45,535 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 77d7be86acc0ccac94456dd0a55825f4 2023-07-20 07:11:45,535 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 77d7be86acc0ccac94456dd0a55825f4 2023-07-20 07:11:45,541 INFO [StoreOpener-77d7be86acc0ccac94456dd0a55825f4-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 77d7be86acc0ccac94456dd0a55825f4 2023-07-20 07:11:45,545 DEBUG [StoreOpener-77d7be86acc0ccac94456dd0a55825f4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/77d7be86acc0ccac94456dd0a55825f4/cf 2023-07-20 07:11:45,545 DEBUG [StoreOpener-77d7be86acc0ccac94456dd0a55825f4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/77d7be86acc0ccac94456dd0a55825f4/cf 2023-07-20 07:11:45,546 INFO [StoreOpener-77d7be86acc0ccac94456dd0a55825f4-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 77d7be86acc0ccac94456dd0a55825f4 columnFamilyName cf 2023-07-20 07:11:45,547 INFO [StoreOpener-fd3a8893515b8e1a864055023aea9a27-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region fd3a8893515b8e1a864055023aea9a27 2023-07-20 07:11:45,547 INFO [StoreOpener-77d7be86acc0ccac94456dd0a55825f4-1] regionserver.HStore(310): Store=77d7be86acc0ccac94456dd0a55825f4/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-20 07:11:45,550 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/77d7be86acc0ccac94456dd0a55825f4 2023-07-20 07:11:45,550 DEBUG [StoreOpener-fd3a8893515b8e1a864055023aea9a27-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/fd3a8893515b8e1a864055023aea9a27/cf 2023-07-20 07:11:45,550 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/77d7be86acc0ccac94456dd0a55825f4 2023-07-20 07:11:45,553 DEBUG [StoreOpener-fd3a8893515b8e1a864055023aea9a27-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/fd3a8893515b8e1a864055023aea9a27/cf 2023-07-20 07:11:45,554 INFO [StoreOpener-fd3a8893515b8e1a864055023aea9a27-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region fd3a8893515b8e1a864055023aea9a27 columnFamilyName cf 2023-07-20 07:11:45,555 INFO [StoreOpener-fd3a8893515b8e1a864055023aea9a27-1] regionserver.HStore(310): Store=fd3a8893515b8e1a864055023aea9a27/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-20 07:11:45,555 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/fd3a8893515b8e1a864055023aea9a27 2023-07-20 07:11:45,556 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/fd3a8893515b8e1a864055023aea9a27 2023-07-20 07:11:45,556 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 77d7be86acc0ccac94456dd0a55825f4 2023-07-20 07:11:45,559 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/77d7be86acc0ccac94456dd0a55825f4/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-20 07:11:45,560 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 77d7be86acc0ccac94456dd0a55825f4; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71758365, jitterRate=0.06928296387195587}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-20 07:11:45,560 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 77d7be86acc0ccac94456dd0a55825f4: 2023-07-20 07:11:45,560 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for fd3a8893515b8e1a864055023aea9a27 2023-07-20 07:11:45,561 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,,1689837105141.77d7be86acc0ccac94456dd0a55825f4., pid=69, masterSystemTime=1689837105530 2023-07-20 07:11:45,563 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,,1689837105141.77d7be86acc0ccac94456dd0a55825f4. 2023-07-20 07:11:45,563 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,,1689837105141.77d7be86acc0ccac94456dd0a55825f4. 2023-07-20 07:11:45,563 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/fd3a8893515b8e1a864055023aea9a27/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-20 07:11:45,563 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=77d7be86acc0ccac94456dd0a55825f4, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,44777,1689837020621 2023-07-20 07:11:45,563 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened fd3a8893515b8e1a864055023aea9a27; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62831167, jitterRate=-0.06374265253543854}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-20 07:11:45,564 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for fd3a8893515b8e1a864055023aea9a27: 2023-07-20 07:11:45,564 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689837105141.77d7be86acc0ccac94456dd0a55825f4.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689837105563"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689837105563"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689837105563"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689837105563"}]},"ts":"1689837105563"} 2023-07-20 07:11:45,564 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,2,1689837105141.fd3a8893515b8e1a864055023aea9a27., pid=70, masterSystemTime=1689837105530 2023-07-20 07:11:45,566 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,2,1689837105141.fd3a8893515b8e1a864055023aea9a27. 2023-07-20 07:11:45,566 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,2,1689837105141.fd3a8893515b8e1a864055023aea9a27. 2023-07-20 07:11:45,566 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=68 updating hbase:meta row=fd3a8893515b8e1a864055023aea9a27, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,44955,1689837020792 2023-07-20 07:11:45,566 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689837105141.fd3a8893515b8e1a864055023aea9a27.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689837105566"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689837105566"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689837105566"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689837105566"}]},"ts":"1689837105566"} 2023-07-20 07:11:45,568 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=69, resume processing ppid=67 2023-07-20 07:11:45,568 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=69, ppid=67, state=SUCCESS; OpenRegionProcedure 77d7be86acc0ccac94456dd0a55825f4, server=jenkins-hbase4.apache.org,44777,1689837020621 in 192 msec 2023-07-20 07:11:45,569 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=67, ppid=66, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=77d7be86acc0ccac94456dd0a55825f4, ASSIGN in 354 msec 2023-07-20 07:11:45,570 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=70, resume processing ppid=68 2023-07-20 07:11:45,570 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=70, ppid=68, state=SUCCESS; OpenRegionProcedure fd3a8893515b8e1a864055023aea9a27, server=jenkins-hbase4.apache.org,44955,1689837020792 in 189 msec 2023-07-20 07:11:45,581 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=68, resume processing ppid=66 2023-07-20 07:11:45,581 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=68, ppid=66, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=fd3a8893515b8e1a864055023aea9a27, ASSIGN in 356 msec 2023-07-20 07:11:45,581 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-20 07:11:45,582 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689837105581"}]},"ts":"1689837105581"} 2023-07-20 07:11:45,583 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=ENABLED in hbase:meta 2023-07-20 07:11:45,586 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_POST_OPERATION 2023-07-20 07:11:45,586 DEBUG [PEWorker-5] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithMergeRegion-1 jenkins: RWXCA 2023-07-20 07:11:45,589 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=44955] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion-1], kv [jenkins: RWXCA] 2023-07-20 07:11:45,592 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): regionserver:44777-0x10181911f0f0001, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-20 07:11:45,592 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): regionserver:45099-0x10181911f0f0002, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-20 07:11:45,592 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): regionserver:44955-0x10181911f0f0003, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-20 07:11:45,592 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): master:37415-0x10181911f0f0000, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-20 07:11:45,594 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-20 07:11:45,594 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-07-20 07:11:45,595 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-20 07:11:45,595 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-20 07:11:45,595 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-07-20 07:11:45,595 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-07-20 07:11:45,596 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-20 07:11:45,596 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-07-20 07:11:45,597 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=66, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 452 msec 2023-07-20 07:11:45,750 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-20 07:11:45,750 INFO [Listener at jenkins-hbase4.apache.org/33837] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 66 completed 2023-07-20 07:11:45,780 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] master.HMaster$2(1952): Client=jenkins//172.31.14.131 merge regions 77d7be86acc0ccac94456dd0a55825f4, fd3a8893515b8e1a864055023aea9a27 2023-07-20 07:11:45,791 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] procedure2.ProcedureExecutor(1029): Stored pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[77d7be86acc0ccac94456dd0a55825f4, fd3a8893515b8e1a864055023aea9a27], force=true 2023-07-20 07:11:45,793 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[77d7be86acc0ccac94456dd0a55825f4, fd3a8893515b8e1a864055023aea9a27], force=true 2023-07-20 07:11:45,793 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[77d7be86acc0ccac94456dd0a55825f4, fd3a8893515b8e1a864055023aea9a27], force=true 2023-07-20 07:11:45,794 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[77d7be86acc0ccac94456dd0a55825f4, fd3a8893515b8e1a864055023aea9a27], force=true 2023-07-20 07:11:45,797 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-20 07:11:45,827 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=77d7be86acc0ccac94456dd0a55825f4, UNASSIGN}, {pid=73, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=fd3a8893515b8e1a864055023aea9a27, UNASSIGN}] 2023-07-20 07:11:45,830 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=73, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=fd3a8893515b8e1a864055023aea9a27, UNASSIGN 2023-07-20 07:11:45,830 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=77d7be86acc0ccac94456dd0a55825f4, UNASSIGN 2023-07-20 07:11:45,831 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=73 updating hbase:meta row=fd3a8893515b8e1a864055023aea9a27, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,44955,1689837020792 2023-07-20 07:11:45,831 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=77d7be86acc0ccac94456dd0a55825f4, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,44777,1689837020621 2023-07-20 07:11:45,831 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689837105141.fd3a8893515b8e1a864055023aea9a27.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689837105830"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689837105830"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689837105830"}]},"ts":"1689837105830"} 2023-07-20 07:11:45,831 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689837105141.77d7be86acc0ccac94456dd0a55825f4.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689837105831"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689837105831"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689837105831"}]},"ts":"1689837105831"} 2023-07-20 07:11:45,832 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=74, ppid=73, state=RUNNABLE; CloseRegionProcedure fd3a8893515b8e1a864055023aea9a27, server=jenkins-hbase4.apache.org,44955,1689837020792}] 2023-07-20 07:11:45,833 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=75, ppid=72, state=RUNNABLE; CloseRegionProcedure 77d7be86acc0ccac94456dd0a55825f4, server=jenkins-hbase4.apache.org,44777,1689837020621}] 2023-07-20 07:11:45,898 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-20 07:11:45,985 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close fd3a8893515b8e1a864055023aea9a27 2023-07-20 07:11:45,987 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing fd3a8893515b8e1a864055023aea9a27, disabling compactions & flushes 2023-07-20 07:11:45,987 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,2,1689837105141.fd3a8893515b8e1a864055023aea9a27. 2023-07-20 07:11:45,987 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1689837105141.fd3a8893515b8e1a864055023aea9a27. 2023-07-20 07:11:45,987 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1689837105141.fd3a8893515b8e1a864055023aea9a27. after waiting 0 ms 2023-07-20 07:11:45,987 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,2,1689837105141.fd3a8893515b8e1a864055023aea9a27. 2023-07-20 07:11:45,987 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing fd3a8893515b8e1a864055023aea9a27 1/1 column families, dataSize=24 B heapSize=352 B 2023-07-20 07:11:45,987 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 77d7be86acc0ccac94456dd0a55825f4 2023-07-20 07:11:45,989 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 77d7be86acc0ccac94456dd0a55825f4, disabling compactions & flushes 2023-07-20 07:11:45,989 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1689837105141.77d7be86acc0ccac94456dd0a55825f4. 2023-07-20 07:11:45,989 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689837105141.77d7be86acc0ccac94456dd0a55825f4. 2023-07-20 07:11:45,989 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689837105141.77d7be86acc0ccac94456dd0a55825f4. after waiting 0 ms 2023-07-20 07:11:45,989 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1689837105141.77d7be86acc0ccac94456dd0a55825f4. 2023-07-20 07:11:45,989 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 77d7be86acc0ccac94456dd0a55825f4 1/1 column families, dataSize=24 B heapSize=352 B 2023-07-20 07:11:46,028 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=24 B at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/fd3a8893515b8e1a864055023aea9a27/.tmp/cf/af9898ff035b454bbe3ee4e28ebeb29a 2023-07-20 07:11:46,043 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=24 B at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/77d7be86acc0ccac94456dd0a55825f4/.tmp/cf/c558eb7a83454e14944304221312e30f 2023-07-20 07:11:46,052 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/77d7be86acc0ccac94456dd0a55825f4/.tmp/cf/c558eb7a83454e14944304221312e30f as hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/77d7be86acc0ccac94456dd0a55825f4/cf/c558eb7a83454e14944304221312e30f 2023-07-20 07:11:46,057 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/fd3a8893515b8e1a864055023aea9a27/.tmp/cf/af9898ff035b454bbe3ee4e28ebeb29a as hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/fd3a8893515b8e1a864055023aea9a27/cf/af9898ff035b454bbe3ee4e28ebeb29a 2023-07-20 07:11:46,059 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/77d7be86acc0ccac94456dd0a55825f4/cf/c558eb7a83454e14944304221312e30f, entries=1, sequenceid=5, filesize=4.7 K 2023-07-20 07:11:46,061 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~24 B/24, heapSize ~336 B/336, currentSize=0 B/0 for 77d7be86acc0ccac94456dd0a55825f4 in 72ms, sequenceid=5, compaction requested=false 2023-07-20 07:11:46,061 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithMergeRegion-1' 2023-07-20 07:11:46,077 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/fd3a8893515b8e1a864055023aea9a27/cf/af9898ff035b454bbe3ee4e28ebeb29a, entries=1, sequenceid=5, filesize=4.7 K 2023-07-20 07:11:46,078 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~24 B/24, heapSize ~336 B/336, currentSize=0 B/0 for fd3a8893515b8e1a864055023aea9a27 in 91ms, sequenceid=5, compaction requested=false 2023-07-20 07:11:46,081 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/77d7be86acc0ccac94456dd0a55825f4/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-07-20 07:11:46,082 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-20 07:11:46,082 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1689837105141.77d7be86acc0ccac94456dd0a55825f4. 2023-07-20 07:11:46,082 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 77d7be86acc0ccac94456dd0a55825f4: 2023-07-20 07:11:46,084 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 77d7be86acc0ccac94456dd0a55825f4 2023-07-20 07:11:46,097 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=77d7be86acc0ccac94456dd0a55825f4, regionState=CLOSED 2023-07-20 07:11:46,097 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689837105141.77d7be86acc0ccac94456dd0a55825f4.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689837106097"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689837106097"}]},"ts":"1689837106097"} 2023-07-20 07:11:46,100 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-20 07:11:46,103 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=75, resume processing ppid=72 2023-07-20 07:11:46,104 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=75, ppid=72, state=SUCCESS; CloseRegionProcedure 77d7be86acc0ccac94456dd0a55825f4, server=jenkins-hbase4.apache.org,44777,1689837020621 in 266 msec 2023-07-20 07:11:46,105 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/fd3a8893515b8e1a864055023aea9a27/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-07-20 07:11:46,105 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=72, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=77d7be86acc0ccac94456dd0a55825f4, UNASSIGN in 280 msec 2023-07-20 07:11:46,106 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-20 07:11:46,106 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,2,1689837105141.fd3a8893515b8e1a864055023aea9a27. 2023-07-20 07:11:46,106 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for fd3a8893515b8e1a864055023aea9a27: 2023-07-20 07:11:46,108 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed fd3a8893515b8e1a864055023aea9a27 2023-07-20 07:11:46,108 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=73 updating hbase:meta row=fd3a8893515b8e1a864055023aea9a27, regionState=CLOSED 2023-07-20 07:11:46,109 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689837105141.fd3a8893515b8e1a864055023aea9a27.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689837106108"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689837106108"}]},"ts":"1689837106108"} 2023-07-20 07:11:46,112 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=74, resume processing ppid=73 2023-07-20 07:11:46,113 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=74, ppid=73, state=SUCCESS; CloseRegionProcedure fd3a8893515b8e1a864055023aea9a27, server=jenkins-hbase4.apache.org,44955,1689837020792 in 279 msec 2023-07-20 07:11:46,117 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=73, resume processing ppid=71 2023-07-20 07:11:46,117 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=73, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=fd3a8893515b8e1a864055023aea9a27, UNASSIGN in 286 msec 2023-07-20 07:11:46,226 DEBUG [PEWorker-5] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/eb86ab66bf67b745d77ff771d4394a7f/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=-1 2023-07-20 07:11:46,228 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689837105141.77d7be86acc0ccac94456dd0a55825f4.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-07-20 07:11:46,229 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689837105141.fd3a8893515b8e1a864055023aea9a27.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-07-20 07:11:46,229 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":7,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689837105142.eb86ab66bf67b745d77ff771d4394a7f.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"merge0000","vlen":84,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"merge0001","vlen":84,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-07-20 07:11:46,285 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=eb86ab66bf67b745d77ff771d4394a7f, ASSIGN}] 2023-07-20 07:11:46,287 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=eb86ab66bf67b745d77ff771d4394a7f, ASSIGN 2023-07-20 07:11:46,288 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=eb86ab66bf67b745d77ff771d4394a7f, ASSIGN; state=MERGED, location=jenkins-hbase4.apache.org,44777,1689837020621; forceNewPlan=false, retain=false 2023-07-20 07:11:46,401 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-20 07:11:46,438 INFO [jenkins-hbase4:37415] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-07-20 07:11:46,440 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=eb86ab66bf67b745d77ff771d4394a7f, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,44777,1689837020621 2023-07-20 07:11:46,440 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689837105142.eb86ab66bf67b745d77ff771d4394a7f.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1689837106440"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689837106440"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689837106440"}]},"ts":"1689837106440"} 2023-07-20 07:11:46,442 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=77, ppid=76, state=RUNNABLE; OpenRegionProcedure eb86ab66bf67b745d77ff771d4394a7f, server=jenkins-hbase4.apache.org,44777,1689837020621}] 2023-07-20 07:11:46,601 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,,1689837105142.eb86ab66bf67b745d77ff771d4394a7f. 2023-07-20 07:11:46,601 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => eb86ab66bf67b745d77ff771d4394a7f, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1689837105142.eb86ab66bf67b745d77ff771d4394a7f.', STARTKEY => '', ENDKEY => ''} 2023-07-20 07:11:46,601 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,,1689837105142.eb86ab66bf67b745d77ff771d4394a7f. service=AccessControlService 2023-07-20 07:11:46,601 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-20 07:11:46,601 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 eb86ab66bf67b745d77ff771d4394a7f 2023-07-20 07:11:46,602 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1689837105142.eb86ab66bf67b745d77ff771d4394a7f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-20 07:11:46,602 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for eb86ab66bf67b745d77ff771d4394a7f 2023-07-20 07:11:46,602 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for eb86ab66bf67b745d77ff771d4394a7f 2023-07-20 07:11:46,603 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(950): Rewriting .regioninfo file at: hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/eb86ab66bf67b745d77ff771d4394a7f/.regioninfo 2023-07-20 07:11:46,639 INFO [StoreOpener-eb86ab66bf67b745d77ff771d4394a7f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region eb86ab66bf67b745d77ff771d4394a7f 2023-07-20 07:11:46,641 DEBUG [StoreOpener-eb86ab66bf67b745d77ff771d4394a7f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/eb86ab66bf67b745d77ff771d4394a7f/cf 2023-07-20 07:11:46,641 DEBUG [StoreOpener-eb86ab66bf67b745d77ff771d4394a7f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/eb86ab66bf67b745d77ff771d4394a7f/cf 2023-07-20 07:11:46,641 INFO [StoreOpener-eb86ab66bf67b745d77ff771d4394a7f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region eb86ab66bf67b745d77ff771d4394a7f columnFamilyName cf 2023-07-20 07:11:46,683 DEBUG [StoreOpener-eb86ab66bf67b745d77ff771d4394a7f-1] regionserver.HStore(539): loaded hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/eb86ab66bf67b745d77ff771d4394a7f/cf/af9898ff035b454bbe3ee4e28ebeb29a.fd3a8893515b8e1a864055023aea9a27->hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/fd3a8893515b8e1a864055023aea9a27/cf/af9898ff035b454bbe3ee4e28ebeb29a-top 2023-07-20 07:11:46,692 DEBUG [StoreOpener-eb86ab66bf67b745d77ff771d4394a7f-1] regionserver.HStore(539): loaded hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/eb86ab66bf67b745d77ff771d4394a7f/cf/c558eb7a83454e14944304221312e30f.77d7be86acc0ccac94456dd0a55825f4->hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/77d7be86acc0ccac94456dd0a55825f4/cf/c558eb7a83454e14944304221312e30f-top 2023-07-20 07:11:46,693 INFO [StoreOpener-eb86ab66bf67b745d77ff771d4394a7f-1] regionserver.HStore(310): Store=eb86ab66bf67b745d77ff771d4394a7f/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-20 07:11:46,694 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/eb86ab66bf67b745d77ff771d4394a7f 2023-07-20 07:11:46,695 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/eb86ab66bf67b745d77ff771d4394a7f 2023-07-20 07:11:46,700 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for eb86ab66bf67b745d77ff771d4394a7f 2023-07-20 07:11:46,701 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened eb86ab66bf67b745d77ff771d4394a7f; next sequenceid=9; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62188188, jitterRate=-0.07332378625869751}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-20 07:11:46,701 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for eb86ab66bf67b745d77ff771d4394a7f: 2023-07-20 07:11:46,702 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,,1689837105142.eb86ab66bf67b745d77ff771d4394a7f., pid=77, masterSystemTime=1689837106597 2023-07-20 07:11:46,703 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.CompactSplit(328): Ignoring compaction request for testtb-testExportFileSystemStateWithMergeRegion-1,,1689837105142.eb86ab66bf67b745d77ff771d4394a7f.,because compaction is disabled. 2023-07-20 07:11:46,705 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,,1689837105142.eb86ab66bf67b745d77ff771d4394a7f. 2023-07-20 07:11:46,705 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,,1689837105142.eb86ab66bf67b745d77ff771d4394a7f. 2023-07-20 07:11:46,706 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=eb86ab66bf67b745d77ff771d4394a7f, regionState=OPEN, openSeqNum=9, regionLocation=jenkins-hbase4.apache.org,44777,1689837020621 2023-07-20 07:11:46,706 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689837105142.eb86ab66bf67b745d77ff771d4394a7f.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1689837106705"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689837106705"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689837106705"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689837106705"}]},"ts":"1689837106705"} 2023-07-20 07:11:46,713 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=77, resume processing ppid=76 2023-07-20 07:11:46,714 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=77, ppid=76, state=SUCCESS; OpenRegionProcedure eb86ab66bf67b745d77ff771d4394a7f, server=jenkins-hbase4.apache.org,44777,1689837020621 in 269 msec 2023-07-20 07:11:46,716 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=76, resume processing ppid=71 2023-07-20 07:11:46,716 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=76, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=eb86ab66bf67b745d77ff771d4394a7f, ASSIGN in 429 msec 2023-07-20 07:11:46,717 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=71, state=SUCCESS; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[77d7be86acc0ccac94456dd0a55825f4, fd3a8893515b8e1a864055023aea9a27], force=true in 932 msec 2023-07-20 07:11:46,902 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-20 07:11:46,903 INFO [Listener at jenkins-hbase4.apache.org/33837] client.HBaseAdmin$TableFuture(3541): Operation: MERGE_REGIONS, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 71 completed 2023-07-20 07:11:46,904 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-07-20 07:11:46,904 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689837106904 (current time:1689837106904). 2023-07-20 07:11:46,904 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-20 07:11:46,904 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] zookeeper.ReadOnlyZKClient(139): Connect 0x468a1739 to 127.0.0.1:58010 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-20 07:11:46,921 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@da61f7c, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-20 07:11:46,923 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-20 07:11:46,926 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:34264, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-20 07:11:46,930 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x468a1739 to 127.0.0.1:58010 2023-07-20 07:11:46,930 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-20 07:11:46,931 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] zookeeper.ReadOnlyZKClient(139): Connect 0x67ffe149 to 127.0.0.1:58010 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-20 07:11:46,951 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@71da1150, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-20 07:11:46,982 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689837028633_0004_000001 (auth:SIMPLE) 2023-07-20 07:11:47,039 DEBUG [hconnection-0x4c3aade8-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-20 07:11:47,043 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:34274, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-20 07:11:47,049 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-20 07:11:47,054 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:44852, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-20 07:11:47,056 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x67ffe149 to 127.0.0.1:58010 2023-07-20 07:11:47,056 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-20 07:11:47,056 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion-1], kv [jenkins: RWXCA] 2023-07-20 07:11:47,057 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-20 07:11:47,057 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-07-20 07:11:47,068 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] procedure2.ProcedureExecutor(1029): Stored pid=78, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-07-20 07:11:47,069 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=78, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-07-20 07:11:47,070 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=78, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE; timeout=600000, timestamp=1689837707070 2023-07-20 07:11:47,070 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-20 07:11:47,070 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-07-20 07:11:47,075 DEBUG [Listener at jenkins-hbase4.apache.org/33837] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-20 07:11:47,076 DEBUG [Listener at jenkins-hbase4.apache.org/33837] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-20 07:11:47,077 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=79, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-07-20 07:11:47,077 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=78, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-07-20 07:11:47,079 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=78, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE in 10 msec 2023-07-20 07:11:47,081 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=79, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-07-20 07:11:47,082 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=79, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED; timeout=600000, timestamp=1689837707082 2023-07-20 07:11:47,093 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 07:11:47,093 INFO [(jenkins-hbase4.apache.org,37415,1689837019114)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' 2023-07-20 07:11:47,093 DEBUG [(jenkins-hbase4.apache.org,37415,1689837019114)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-20 07:11:47,095 DEBUG [(jenkins-hbase4.apache.org,37415,1689837019114)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' 2023-07-20 07:11:47,095 DEBUG [(jenkins-hbase4.apache.org,37415,1689837019114)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1', kicking off acquire phase on members. 2023-07-20 07:11:47,096 DEBUG [(jenkins-hbase4.apache.org,37415,1689837019114)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37415-0x10181911f0f0000, quorum=127.0.0.1:58010, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 07:11:47,096 DEBUG [(jenkins-hbase4.apache.org,37415,1689837019114)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 07:11:47,099 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): regionserver:44777-0x10181911f0f0001, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 07:11:47,099 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): regionserver:45099-0x10181911f0f0002, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 07:11:47,099 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 07:11:47,099 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 07:11:47,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 07:11:47,099 DEBUG [(jenkins-hbase4.apache.org,37415,1689837019114)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,44777,1689837020621 2023-07-20 07:11:47,099 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): regionserver:44955-0x10181911f0f0003, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 07:11:47,099 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 07:11:47,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 07:11:47,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 07:11:47,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 07:11:47,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 07:11:47,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 07:11:47,100 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44955-0x10181911f0f0003, quorum=127.0.0.1:58010, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 07:11:47,100 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45099-0x10181911f0f0002, quorum=127.0.0.1:58010, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 07:11:47,100 DEBUG [(jenkins-hbase4.apache.org,37415,1689837019114)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37415-0x10181911f0f0000, quorum=127.0.0.1:58010, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,44777,1689837020621 2023-07-20 07:11:47,100 DEBUG [(jenkins-hbase4.apache.org,37415,1689837019114)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-20 07:11:47,102 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44777-0x10181911f0f0001, quorum=127.0.0.1:58010, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 07:11:47,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-07-20 07:11:47,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 07:11:47,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-07-20 07:11:47,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 07:11:47,102 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-07-20 07:11:47,102 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-07-20 07:11:47,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-07-20 07:11:47,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 07:11:47,102 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 07:11:47,102 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-07-20 07:11:47,103 DEBUG [member: 'jenkins-hbase4.apache.org,44955,1689837020792' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-07-20 07:11:47,103 DEBUG [member: 'jenkins-hbase4.apache.org,44955,1689837020792' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-20 07:11:47,106 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 07:11:47,108 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 07:11:47,107 DEBUG [member: 'jenkins-hbase4.apache.org,44955,1689837020792' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-07-20 07:11:47,108 DEBUG [member: 'jenkins-hbase4.apache.org,44777,1689837020621' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-07-20 07:11:47,108 DEBUG [member: 'jenkins-hbase4.apache.org,44777,1689837020621' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-20 07:11:47,108 DEBUG [member: 'jenkins-hbase4.apache.org,45099,1689837020733' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-07-20 07:11:47,109 DEBUG [member: 'jenkins-hbase4.apache.org,44777,1689837020621' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-07-20 07:11:47,109 DEBUG [member: 'jenkins-hbase4.apache.org,45099,1689837020733' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-20 07:11:47,108 DEBUG [member: 'jenkins-hbase4.apache.org,44955,1689837020792' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-07-20 07:11:47,110 DEBUG [member: 'jenkins-hbase4.apache.org,45099,1689837020733' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-07-20 07:11:47,110 DEBUG [member: 'jenkins-hbase4.apache.org,45099,1689837020733' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-07-20 07:11:47,110 DEBUG [member: 'jenkins-hbase4.apache.org,45099,1689837020733' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45099,1689837020733' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-07-20 07:11:47,109 DEBUG [member: 'jenkins-hbase4.apache.org,44777,1689837020621' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-07-20 07:11:47,110 DEBUG [member: 'jenkins-hbase4.apache.org,44955,1689837020792' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44955,1689837020792' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-07-20 07:11:47,110 DEBUG [member: 'jenkins-hbase4.apache.org,44777,1689837020621' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44777,1689837020621' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-07-20 07:11:47,117 DEBUG [member: 'jenkins-hbase4.apache.org,44955,1689837020792' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 07:11:47,118 DEBUG [member: 'jenkins-hbase4.apache.org,44777,1689837020621' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 07:11:47,118 DEBUG [member: 'jenkins-hbase4.apache.org,44955,1689837020792' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44955-0x10181911f0f0003, quorum=127.0.0.1:58010, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 07:11:47,118 DEBUG [member: 'jenkins-hbase4.apache.org,44955,1689837020792' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-20 07:11:47,118 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): master:37415-0x10181911f0f0000, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,44777,1689837020621 2023-07-20 07:11:47,118 DEBUG [member: 'jenkins-hbase4.apache.org,45099,1689837020733' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 07:11:47,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,44777,1689837020621 2023-07-20 07:11:47,119 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-20 07:11:47,119 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-20 07:11:47,119 DEBUG [member: 'jenkins-hbase4.apache.org,44777,1689837020621' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44777-0x10181911f0f0001, quorum=127.0.0.1:58010, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 07:11:47,119 DEBUG [member: 'jenkins-hbase4.apache.org,44777,1689837020621' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-20 07:11:47,119 DEBUG [member: 'jenkins-hbase4.apache.org,45099,1689837020733' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45099-0x10181911f0f0002, quorum=127.0.0.1:58010, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 07:11:47,119 DEBUG [member: 'jenkins-hbase4.apache.org,45099,1689837020733' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-20 07:11:47,119 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-20 07:11:47,119 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-20 07:11:47,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 07:11:47,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44955,1689837020792 2023-07-20 07:11:47,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44777,1689837020621 2023-07-20 07:11:47,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45099,1689837020733 2023-07-20 07:11:47,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-20 07:11:47,127 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44777,1689837020621' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' on coordinator 2023-07-20 07:11:47,127 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@132ab97e[Count = 0] remaining members to acquire global barrier 2023-07-20 07:11:47,127 DEBUG [(jenkins-hbase4.apache.org,37415,1689837019114)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'in-barrier' execution. 2023-07-20 07:11:47,127 DEBUG [(jenkins-hbase4.apache.org,37415,1689837019114)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 07:11:47,129 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): regionserver:45099-0x10181911f0f0002, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 07:11:47,129 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): regionserver:44955-0x10181911f0f0003, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 07:11:47,129 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 07:11:47,129 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 07:11:47,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 07:11:47,129 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): regionserver:44777-0x10181911f0f0001, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 07:11:47,129 DEBUG [member: 'jenkins-hbase4.apache.org,45099,1689837020733' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-07-20 07:11:47,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 07:11:47,129 DEBUG [member: 'jenkins-hbase4.apache.org,44955,1689837020792' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-07-20 07:11:47,130 DEBUG [member: 'jenkins-hbase4.apache.org,44955,1689837020792' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-07-20 07:11:47,130 DEBUG [member: 'jenkins-hbase4.apache.org,44955,1689837020792' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase4.apache.org,44955,1689837020792' in zk 2023-07-20 07:11:47,129 DEBUG [member: 'jenkins-hbase4.apache.org,45099,1689837020733' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-07-20 07:11:47,129 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 07:11:47,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 07:11:47,130 DEBUG [member: 'jenkins-hbase4.apache.org,44777,1689837020621' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-07-20 07:11:47,130 DEBUG [member: 'jenkins-hbase4.apache.org,45099,1689837020733' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase4.apache.org,45099,1689837020733' in zk 2023-07-20 07:11:47,130 DEBUG [(jenkins-hbase4.apache.org,37415,1689837019114)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37415-0x10181911f0f0000, quorum=127.0.0.1:58010, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,44777,1689837020621 2023-07-20 07:11:47,130 DEBUG [(jenkins-hbase4.apache.org,37415,1689837019114)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-20 07:11:47,132 DEBUG [member: 'jenkins-hbase4.apache.org,44955,1689837020792' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-07-20 07:11:47,132 DEBUG [member: 'jenkins-hbase4.apache.org,44955,1689837020792' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-20 07:11:47,132 DEBUG [member: 'jenkins-hbase4.apache.org,44955,1689837020792' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-07-20 07:11:47,135 DEBUG [member: 'jenkins-hbase4.apache.org,44777,1689837020621' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-20 07:11:47,135 DEBUG [member: 'jenkins-hbase4.apache.org,44777,1689837020621' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-20 07:11:47,135 DEBUG [member: 'jenkins-hbase4.apache.org,45099,1689837020733' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-07-20 07:11:47,135 DEBUG [member: 'jenkins-hbase4.apache.org,45099,1689837020733' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-20 07:11:47,135 DEBUG [rs(jenkins-hbase4.apache.org,44777,1689837020621)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion-1,,1689837105142.eb86ab66bf67b745d77ff771d4394a7f. 2023-07-20 07:11:47,135 DEBUG [member: 'jenkins-hbase4.apache.org,45099,1689837020733' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-07-20 07:11:47,135 DEBUG [rs(jenkins-hbase4.apache.org,44777,1689837020621)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion-1,,1689837105142.eb86ab66bf67b745d77ff771d4394a7f. started... 2023-07-20 07:11:47,143 DEBUG [rs(jenkins-hbase4.apache.org,44777,1689837020621)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for eb86ab66bf67b745d77ff771d4394a7f: 2023-07-20 07:11:47,143 DEBUG [rs(jenkins-hbase4.apache.org,44777,1689837020621)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion-1,,1689837105142.eb86ab66bf67b745d77ff771d4394a7f.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 07:11:47,143 DEBUG [rs(jenkins-hbase4.apache.org,44777,1689837020621)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-20 07:11:47,144 DEBUG [rs(jenkins-hbase4.apache.org,44777,1689837020621)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/eb86ab66bf67b745d77ff771d4394a7f/cf/af9898ff035b454bbe3ee4e28ebeb29a.fd3a8893515b8e1a864055023aea9a27->hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/fd3a8893515b8e1a864055023aea9a27/cf/af9898ff035b454bbe3ee4e28ebeb29a-top, hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/eb86ab66bf67b745d77ff771d4394a7f/cf/c558eb7a83454e14944304221312e30f.77d7be86acc0ccac94456dd0a55825f4->hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/77d7be86acc0ccac94456dd0a55825f4/cf/c558eb7a83454e14944304221312e30f-top] hfiles 2023-07-20 07:11:47,144 DEBUG [rs(jenkins-hbase4.apache.org,44777,1689837020621)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/2): hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/eb86ab66bf67b745d77ff771d4394a7f/cf/af9898ff035b454bbe3ee4e28ebeb29a.fd3a8893515b8e1a864055023aea9a27 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 07:11:47,144 DEBUG [rs(jenkins-hbase4.apache.org,44777,1689837020621)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (2/2): hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/eb86ab66bf67b745d77ff771d4394a7f/cf/c558eb7a83454e14944304221312e30f.77d7be86acc0ccac94456dd0a55825f4 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 07:11:47,176 DEBUG [Listener at jenkins-hbase4.apache.org/33837] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-20 07:11:47,179 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } is done 2023-07-20 07:11:47,179 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }' is still in progress! 2023-07-20 07:11:47,180 DEBUG [Listener at jenkins-hbase4.apache.org/33837] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-20 07:11:47,189 DEBUG [rs(jenkins-hbase4.apache.org,44777,1689837020621)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion-1,,1689837105142.eb86ab66bf67b745d77ff771d4394a7f. completed. 2023-07-20 07:11:47,189 DEBUG [rs(jenkins-hbase4.apache.org,44777,1689837020621)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion-1,,1689837105142.eb86ab66bf67b745d77ff771d4394a7f. 2023-07-20 07:11:47,189 DEBUG [member: 'jenkins-hbase4.apache.org,44777,1689837020621' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-20 07:11:47,189 DEBUG [member: 'jenkins-hbase4.apache.org,44777,1689837020621' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-20 07:11:47,189 DEBUG [member: 'jenkins-hbase4.apache.org,44777,1689837020621' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,44777,1689837020621 2023-07-20 07:11:47,189 DEBUG [member: 'jenkins-hbase4.apache.org,44777,1689837020621' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-07-20 07:11:47,189 DEBUG [member: 'jenkins-hbase4.apache.org,44777,1689837020621' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase4.apache.org,44777,1689837020621' in zk 2023-07-20 07:11:47,195 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): master:37415-0x10181911f0f0000, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,44777,1689837020621 2023-07-20 07:11:47,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,44777,1689837020621 2023-07-20 07:11:47,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-20 07:11:47,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-20 07:11:47,195 DEBUG [member: 'jenkins-hbase4.apache.org,44777,1689837020621' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-07-20 07:11:47,195 DEBUG [member: 'jenkins-hbase4.apache.org,44777,1689837020621' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-20 07:11:47,195 DEBUG [member: 'jenkins-hbase4.apache.org,44777,1689837020621' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-07-20 07:11:47,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-20 07:11:47,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-20 07:11:47,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 07:11:47,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44955,1689837020792 2023-07-20 07:11:47,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44777,1689837020621 2023-07-20 07:11:47,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45099,1689837020733 2023-07-20 07:11:47,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-20 07:11:47,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 07:11:47,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44955,1689837020792 2023-07-20 07:11:47,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44777,1689837020621 2023-07-20 07:11:47,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45099,1689837020733 2023-07-20 07:11:47,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' member 'jenkins-hbase4.apache.org,44777,1689837020621': 2023-07-20 07:11:47,199 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44777,1689837020621' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion-1', counting down latch. Waiting for 0 more 2023-07-20 07:11:47,199 INFO [(jenkins-hbase4.apache.org,37415,1689837019114)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' execution completed 2023-07-20 07:11:47,200 DEBUG [(jenkins-hbase4.apache.org,37415,1689837019114)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-20 07:11:47,200 DEBUG [(jenkins-hbase4.apache.org,37415,1689837019114)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-20 07:11:47,200 DEBUG [(jenkins-hbase4.apache.org,37415,1689837019114)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 07:11:47,200 INFO [(jenkins-hbase4.apache.org,37415,1689837019114)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithMergeRegion-1including nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-20 07:11:47,202 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): master:37415-0x10181911f0f0000, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 07:11:47,202 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): regionserver:45099-0x10181911f0f0002, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 07:11:47,202 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): regionserver:44777-0x10181911f0f0001, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 07:11:47,202 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 07:11:47,202 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-20 07:11:47,202 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-20 07:11:47,202 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 07:11:47,202 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 07:11:47,202 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): regionserver:44777-0x10181911f0f0001, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 07:11:47,202 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 07:11:47,202 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): regionserver:45099-0x10181911f0f0002, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 07:11:47,202 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): regionserver:44955-0x10181911f0f0003, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 07:11:47,203 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): regionserver:44955-0x10181911f0f0003, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 07:11:47,203 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 07:11:47,203 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 07:11:47,203 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 07:11:47,203 DEBUG [(jenkins-hbase4.apache.org,37415,1689837019114)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37415-0x10181911f0f0000, quorum=127.0.0.1:58010, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,44955,1689837020792 2023-07-20 07:11:47,203 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-20 07:11:47,204 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 07:11:47,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 07:11:47,204 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 07:11:47,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 07:11:47,205 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 07:11:47,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 07:11:47,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 07:11:47,204 DEBUG [(jenkins-hbase4.apache.org,37415,1689837019114)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37415-0x10181911f0f0000, quorum=127.0.0.1:58010, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,44777,1689837020621 2023-07-20 07:11:47,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 07:11:47,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 07:11:47,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 07:11:47,205 DEBUG [(jenkins-hbase4.apache.org,37415,1689837019114)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37415-0x10181911f0f0000, quorum=127.0.0.1:58010, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,45099,1689837020733 2023-07-20 07:11:47,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-20 07:11:47,206 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 07:11:47,206 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44955,1689837020792 2023-07-20 07:11:47,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44777,1689837020621 2023-07-20 07:11:47,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45099,1689837020733 2023-07-20 07:11:47,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-20 07:11:47,208 DEBUG [(jenkins-hbase4.apache.org,37415,1689837019114)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37415-0x10181911f0f0000, quorum=127.0.0.1:58010, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,44955,1689837020792 2023-07-20 07:11:47,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 07:11:47,208 DEBUG [(jenkins-hbase4.apache.org,37415,1689837019114)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37415-0x10181911f0f0000, quorum=127.0.0.1:58010, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,44777,1689837020621 2023-07-20 07:11:47,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44955,1689837020792 2023-07-20 07:11:47,209 DEBUG [(jenkins-hbase4.apache.org,37415,1689837019114)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37415-0x10181911f0f0000, quorum=127.0.0.1:58010, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,45099,1689837020733 2023-07-20 07:11:47,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44777,1689837020621 2023-07-20 07:11:47,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45099,1689837020733 2023-07-20 07:11:47,213 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): regionserver:44955-0x10181911f0f0003, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 07:11:47,213 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): regionserver:45099-0x10181911f0f0002, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 07:11:47,213 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): regionserver:44777-0x10181911f0f0001, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 07:11:47,213 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): regionserver:44777-0x10181911f0f0001, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 07:11:47,213 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): master:37415-0x10181911f0f0000, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,45099,1689837020733 2023-07-20 07:11:47,213 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): master:37415-0x10181911f0f0000, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 07:11:47,213 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): regionserver:44955-0x10181911f0f0003, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 07:11:47,213 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 07:11:47,213 DEBUG [(jenkins-hbase4.apache.org,37415,1689837019114)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-20 07:11:47,213 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 07:11:47,213 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 07:11:47,213 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 07:11:47,213 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 07:11:47,213 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 07:11:47,213 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 07:11:47,213 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): master:37415-0x10181911f0f0000, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,44777,1689837020621 2023-07-20 07:11:47,214 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 07:11:47,214 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 07:11:47,214 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 07:11:47,213 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): regionserver:45099-0x10181911f0f0002, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 07:11:47,214 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): master:37415-0x10181911f0f0000, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,44955,1689837020792 2023-07-20 07:11:47,214 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): master:37415-0x10181911f0f0000, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 07:11:47,214 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): master:37415-0x10181911f0f0000, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,45099,1689837020733 2023-07-20 07:11:47,214 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): master:37415-0x10181911f0f0000, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 07:11:47,214 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): master:37415-0x10181911f0f0000, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,44777,1689837020621 2023-07-20 07:11:47,214 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): master:37415-0x10181911f0f0000, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,44955,1689837020792 2023-07-20 07:11:47,214 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): master:37415-0x10181911f0f0000, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 07:11:47,214 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): master:37415-0x10181911f0f0000, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 07:11:47,214 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 07:11:47,214 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 07:11:47,215 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 07:11:47,218 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 07:11:47,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 07:11:47,285 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 to hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 07:11:47,356 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 of table testtb-testExportFileSystemStateWithMergeRegion-1 completed 2023-07-20 07:11:47,357 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 07:11:47,358 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 07:11:47,358 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion-1 at 1689837107070Consolidate snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1689837107214 (+144 ms)Loading Region manifests for snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1689837107214Writing data manifest for snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1689837107221 (+7 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1689837107264 (+43 ms)Snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 of table testtb-testExportFileSystemStateWithMergeRegion-1 completed at 1689837107356 (+92 ms) 2023-07-20 07:11:47,361 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=79, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-07-20 07:11:47,374 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=79, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED in 287 msec 2023-07-20 07:11:47,380 DEBUG [Listener at jenkins-hbase4.apache.org/33837] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-20 07:11:47,381 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } is done 2023-07-20 07:11:47,381 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-20 07:11:47,382 INFO [Listener at jenkins-hbase4.apache.org/33837] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/export-test/export-1689837107382 2023-07-20 07:11:47,382 INFO [Listener at jenkins-hbase4.apache.org/33837] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:39649, tgtDir=hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/export-test/export-1689837107382, rawTgtDir=hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/export-test/export-1689837107382, srcFsUri=hdfs://localhost:39649, srcDir=hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b 2023-07-20 07:11:47,415 DEBUG [Listener at jenkins-hbase4.apache.org/33837] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:39649, inputRoot=hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b 2023-07-20 07:11:47,416 DEBUG [Listener at jenkins-hbase4.apache.org/33837] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_2024317098_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/export-test/export-1689837107382, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/export-test/export-1689837107382/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 07:11:47,416 INFO [Listener at jenkins-hbase4.apache.org/33837] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:39649, inputRoot=hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b, snapshotDir=hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1. 2023-07-20 07:11:47,433 INFO [Listener at jenkins-hbase4.apache.org/33837] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 to hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/export-test/export-1689837107382/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 07:11:47,512 DEBUG [Listener at jenkins-hbase4.apache.org/33837] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-20 07:11:47,512 DEBUG [Listener at jenkins-hbase4.apache.org/33837] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-20 07:11:47,512 DEBUG [Listener at jenkins-hbase4.apache.org/33837] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-20 07:11:47,513 DEBUG [Listener at jenkins-hbase4.apache.org/33837] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-20 07:11:47,513 DEBUG [Listener at jenkins-hbase4.apache.org/33837] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-20 07:11:47,513 DEBUG [Listener at jenkins-hbase4.apache.org/33837] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-20 07:11:47,514 DEBUG [Listener at jenkins-hbase4.apache.org/33837] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-20 07:11:47,599 DEBUG [Listener at jenkins-hbase4.apache.org/33837] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c07d5e8c-eba2-0ae8-aa3a-b7afa648e7e7/hadoop-2739887039088013268.jar 2023-07-20 07:11:47,600 DEBUG [Listener at jenkins-hbase4.apache.org/33837] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-20 07:11:47,600 DEBUG [Listener at jenkins-hbase4.apache.org/33837] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-20 07:11:47,600 DEBUG [Listener at jenkins-hbase4.apache.org/33837] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-20 07:11:47,601 DEBUG [Listener at jenkins-hbase4.apache.org/33837] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-20 07:11:47,601 DEBUG [Listener at jenkins-hbase4.apache.org/33837] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-20 07:11:47,602 DEBUG [Listener at jenkins-hbase4.apache.org/33837] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-20 07:11:47,602 DEBUG [Listener at jenkins-hbase4.apache.org/33837] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-20 07:11:47,603 DEBUG [Listener at jenkins-hbase4.apache.org/33837] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-20 07:11:47,603 DEBUG [Listener at jenkins-hbase4.apache.org/33837] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-20 07:11:47,604 DEBUG [Listener at jenkins-hbase4.apache.org/33837] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-20 07:11:47,605 DEBUG [Listener at jenkins-hbase4.apache.org/33837] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-20 07:11:47,605 DEBUG [Listener at jenkins-hbase4.apache.org/33837] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-20 07:11:47,606 DEBUG [Listener at jenkins-hbase4.apache.org/33837] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-20 07:11:47,606 DEBUG [Listener at jenkins-hbase4.apache.org/33837] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-20 07:11:47,606 DEBUG [Listener at jenkins-hbase4.apache.org/33837] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-20 07:11:47,607 DEBUG [Listener at jenkins-hbase4.apache.org/33837] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-20 07:11:47,607 DEBUG [Listener at jenkins-hbase4.apache.org/33837] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-20 07:11:47,608 DEBUG [Listener at jenkins-hbase4.apache.org/33837] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-20 07:11:47,608 DEBUG [Listener at jenkins-hbase4.apache.org/33837] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-20 07:11:47,608 DEBUG [Listener at jenkins-hbase4.apache.org/33837] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-20 07:11:47,608 DEBUG [Listener at jenkins-hbase4.apache.org/33837] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-20 07:11:47,609 DEBUG [Listener at jenkins-hbase4.apache.org/33837] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-20 07:11:47,609 DEBUG [Listener at jenkins-hbase4.apache.org/33837] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-20 07:11:48,778 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-20 07:11:49,457 WARN [Listener at jenkins-hbase4.apache.org/33837] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-20 07:11:49,460 INFO [Listener at jenkins-hbase4.apache.org/33837] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemStateWithMergeRegion-1' hfile list 2023-07-20 07:11:49,464 DEBUG [Listener at jenkins-hbase4.apache.org/33837] snapshot.ExportSnapshot(671): export split=0 size=9.5 K 2023-07-20 07:11:49,618 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-20 07:11:49,618 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-20 07:11:49,988 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689837028633_0005_000001 (auth:SIMPLE) 2023-07-20 07:11:56,228 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689837028633_0005_000001 (auth:SIMPLE) 2023-07-20 07:11:58,715 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689837028633_0005_000001 (auth:SIMPLE) 2023-07-20 07:12:02,697 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689837028633_0005_000001 (auth:SIMPLE) 2023-07-20 07:12:03,821 INFO [Listener at jenkins-hbase4.apache.org/33837] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-20 07:12:03,826 INFO [Listener at jenkins-hbase4.apache.org/33837] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-20 07:12:03,847 INFO [Listener at jenkins-hbase4.apache.org/33837] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 07:12:03,847 INFO [Listener at jenkins-hbase4.apache.org/33837] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-20 07:12:03,848 INFO [Listener at jenkins-hbase4.apache.org/33837] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-20 07:12:03,848 DEBUG [Listener at jenkins-hbase4.apache.org/33837] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_759529442_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 at hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 07:12:03,851 DEBUG [Listener at jenkins-hbase4.apache.org/33837] snapshot.TestExportSnapshot(367): hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/.snapshotinfo 2023-07-20 07:12:03,851 DEBUG [Listener at jenkins-hbase4.apache.org/33837] snapshot.TestExportSnapshot(367): hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/data.manifest 2023-07-20 07:12:03,851 DEBUG [Listener at jenkins-hbase4.apache.org/33837] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_759529442_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/export-test/export-1689837107382/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 at hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/export-test/export-1689837107382/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 07:12:03,851 DEBUG [Listener at jenkins-hbase4.apache.org/33837] snapshot.TestExportSnapshot(367): hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/export-test/export-1689837107382/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/.snapshotinfo 2023-07-20 07:12:03,852 DEBUG [Listener at jenkins-hbase4.apache.org/33837] snapshot.TestExportSnapshot(367): hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/export-test/export-1689837107382/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/data.manifest 2023-07-20 07:12:03,865 INFO [Listener at jenkins-hbase4.apache.org/33837] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-20 07:12:03,866 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-20 07:12:03,867 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] procedure2.ProcedureExecutor(1029): Stored pid=80, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-20 07:12:03,872 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-07-20 07:12:03,873 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689837123873"}]},"ts":"1689837123873"} 2023-07-20 07:12:03,875 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=DISABLING in hbase:meta 2023-07-20 07:12:03,879 INFO [PEWorker-3] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithMergeRegion-1 to state=DISABLING 2023-07-20 07:12:03,880 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=81, ppid=80, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=eb86ab66bf67b745d77ff771d4394a7f, UNASSIGN}] 2023-07-20 07:12:03,881 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=81, ppid=80, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=eb86ab66bf67b745d77ff771d4394a7f, UNASSIGN 2023-07-20 07:12:03,882 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=eb86ab66bf67b745d77ff771d4394a7f, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,44777,1689837020621 2023-07-20 07:12:03,883 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689837105142.eb86ab66bf67b745d77ff771d4394a7f.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1689837123882"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689837123882"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689837123882"}]},"ts":"1689837123882"} 2023-07-20 07:12:03,886 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=82, ppid=81, state=RUNNABLE; CloseRegionProcedure eb86ab66bf67b745d77ff771d4394a7f, server=jenkins-hbase4.apache.org,44777,1689837020621}] 2023-07-20 07:12:03,974 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-07-20 07:12:04,043 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close eb86ab66bf67b745d77ff771d4394a7f 2023-07-20 07:12:04,043 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing eb86ab66bf67b745d77ff771d4394a7f, disabling compactions & flushes 2023-07-20 07:12:04,043 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1689837105142.eb86ab66bf67b745d77ff771d4394a7f. 2023-07-20 07:12:04,044 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689837105142.eb86ab66bf67b745d77ff771d4394a7f. 2023-07-20 07:12:04,044 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689837105142.eb86ab66bf67b745d77ff771d4394a7f. after waiting 0 ms 2023-07-20 07:12:04,044 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1689837105142.eb86ab66bf67b745d77ff771d4394a7f. 2023-07-20 07:12:04,064 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/eb86ab66bf67b745d77ff771d4394a7f/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=8 2023-07-20 07:12:04,065 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-20 07:12:04,066 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1689837105142.eb86ab66bf67b745d77ff771d4394a7f. 2023-07-20 07:12:04,066 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for eb86ab66bf67b745d77ff771d4394a7f: 2023-07-20 07:12:04,067 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed eb86ab66bf67b745d77ff771d4394a7f 2023-07-20 07:12:04,068 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=eb86ab66bf67b745d77ff771d4394a7f, regionState=CLOSED 2023-07-20 07:12:04,068 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689837105142.eb86ab66bf67b745d77ff771d4394a7f.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1689837124068"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689837124068"}]},"ts":"1689837124068"} 2023-07-20 07:12:04,071 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=82, resume processing ppid=81 2023-07-20 07:12:04,072 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=82, ppid=81, state=SUCCESS; CloseRegionProcedure eb86ab66bf67b745d77ff771d4394a7f, server=jenkins-hbase4.apache.org,44777,1689837020621 in 184 msec 2023-07-20 07:12:04,073 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=81, resume processing ppid=80 2023-07-20 07:12:04,073 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=81, ppid=80, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=eb86ab66bf67b745d77ff771d4394a7f, UNASSIGN in 191 msec 2023-07-20 07:12:04,074 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689837124074"}]},"ts":"1689837124074"} 2023-07-20 07:12:04,075 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=DISABLED in hbase:meta 2023-07-20 07:12:04,078 INFO [PEWorker-2] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithMergeRegion-1 to state=DISABLED 2023-07-20 07:12:04,080 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=80, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 212 msec 2023-07-20 07:12:04,175 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-07-20 07:12:04,175 INFO [Listener at jenkins-hbase4.apache.org/33837] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 80 completed 2023-07-20 07:12:04,176 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-20 07:12:04,178 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] procedure2.ProcedureExecutor(1029): Stored pid=83, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-20 07:12:04,180 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=83, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-20 07:12:04,181 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-20 07:12:04,181 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=83, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-20 07:12:04,182 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=44955] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-20 07:12:04,186 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/fd3a8893515b8e1a864055023aea9a27 2023-07-20 07:12:04,186 DEBUG [HFileArchiver-19] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/eb86ab66bf67b745d77ff771d4394a7f 2023-07-20 07:12:04,186 DEBUG [HFileArchiver-20] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/77d7be86acc0ccac94456dd0a55825f4 2023-07-20 07:12:04,187 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): regionserver:45099-0x10181911f0f0002, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-20 07:12:04,187 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): master:37415-0x10181911f0f0000, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-20 07:12:04,187 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): regionserver:44777-0x10181911f0f0001, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-20 07:12:04,187 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): regionserver:44955-0x10181911f0f0003, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-20 07:12:04,187 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-07-20 07:12:04,187 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-07-20 07:12:04,187 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-07-20 07:12:04,187 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-07-20 07:12:04,188 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/fd3a8893515b8e1a864055023aea9a27/cf, FileablePath, hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/fd3a8893515b8e1a864055023aea9a27/recovered.edits] 2023-07-20 07:12:04,189 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): regionserver:45099-0x10181911f0f0002, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-20 07:12:04,189 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): regionserver:45099-0x10181911f0f0002, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-20 07:12:04,189 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): master:37415-0x10181911f0f0000, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-20 07:12:04,189 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): regionserver:44955-0x10181911f0f0003, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-20 07:12:04,189 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): master:37415-0x10181911f0f0000, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-20 07:12:04,189 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): regionserver:44955-0x10181911f0f0003, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-20 07:12:04,189 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): regionserver:44777-0x10181911f0f0001, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-20 07:12:04,189 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): regionserver:44777-0x10181911f0f0001, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-20 07:12:04,190 DEBUG [HFileArchiver-19] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/eb86ab66bf67b745d77ff771d4394a7f/cf, FileablePath, hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/eb86ab66bf67b745d77ff771d4394a7f/recovered.edits] 2023-07-20 07:12:04,190 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-20 07:12:04,190 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-20 07:12:04,190 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] master.MasterRpcServices(1230): Checking to see if procedure is done pid=83 2023-07-20 07:12:04,190 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-20 07:12:04,190 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-20 07:12:04,191 DEBUG [HFileArchiver-20] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/77d7be86acc0ccac94456dd0a55825f4/cf, FileablePath, hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/77d7be86acc0ccac94456dd0a55825f4/recovered.edits] 2023-07-20 07:12:04,194 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/fd3a8893515b8e1a864055023aea9a27/cf/af9898ff035b454bbe3ee4e28ebeb29a to hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/fd3a8893515b8e1a864055023aea9a27/cf/af9898ff035b454bbe3ee4e28ebeb29a 2023-07-20 07:12:04,195 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/eb86ab66bf67b745d77ff771d4394a7f/cf/af9898ff035b454bbe3ee4e28ebeb29a.fd3a8893515b8e1a864055023aea9a27 to hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/eb86ab66bf67b745d77ff771d4394a7f/cf/af9898ff035b454bbe3ee4e28ebeb29a.fd3a8893515b8e1a864055023aea9a27 2023-07-20 07:12:04,195 DEBUG [HFileArchiver-20] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/77d7be86acc0ccac94456dd0a55825f4/cf/c558eb7a83454e14944304221312e30f to hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/77d7be86acc0ccac94456dd0a55825f4/cf/c558eb7a83454e14944304221312e30f 2023-07-20 07:12:04,197 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/eb86ab66bf67b745d77ff771d4394a7f/cf/c558eb7a83454e14944304221312e30f.77d7be86acc0ccac94456dd0a55825f4 to hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/eb86ab66bf67b745d77ff771d4394a7f/cf/c558eb7a83454e14944304221312e30f.77d7be86acc0ccac94456dd0a55825f4 2023-07-20 07:12:04,197 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/fd3a8893515b8e1a864055023aea9a27/recovered.edits/8.seqid to hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/fd3a8893515b8e1a864055023aea9a27/recovered.edits/8.seqid 2023-07-20 07:12:04,198 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/fd3a8893515b8e1a864055023aea9a27 2023-07-20 07:12:04,199 DEBUG [HFileArchiver-20] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/77d7be86acc0ccac94456dd0a55825f4/recovered.edits/8.seqid to hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/77d7be86acc0ccac94456dd0a55825f4/recovered.edits/8.seqid 2023-07-20 07:12:04,200 DEBUG [HFileArchiver-20] backup.HFileArchiver(596): Deleted hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/77d7be86acc0ccac94456dd0a55825f4 2023-07-20 07:12:04,200 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/eb86ab66bf67b745d77ff771d4394a7f/recovered.edits/12.seqid to hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/eb86ab66bf67b745d77ff771d4394a7f/recovered.edits/12.seqid 2023-07-20 07:12:04,201 DEBUG [HFileArchiver-19] backup.HFileArchiver(596): Deleted hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/eb86ab66bf67b745d77ff771d4394a7f 2023-07-20 07:12:04,201 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion-1 regions 2023-07-20 07:12:04,203 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=83, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-20 07:12:04,209 WARN [PEWorker-3] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of testtb-testExportFileSystemStateWithMergeRegion-1 from hbase:meta 2023-07-20 07:12:04,212 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithMergeRegion-1' descriptor. 2023-07-20 07:12:04,214 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=83, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-20 07:12:04,214 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithMergeRegion-1' from region states. 2023-07-20 07:12:04,214 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689837105142.eb86ab66bf67b745d77ff771d4394a7f.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689837124214"}]},"ts":"9223372036854775807"} 2023-07-20 07:12:04,223 INFO [PEWorker-3] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2023-07-20 07:12:04,223 DEBUG [PEWorker-3] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => eb86ab66bf67b745d77ff771d4394a7f, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1689837105142.eb86ab66bf67b745d77ff771d4394a7f.', STARTKEY => '', ENDKEY => ''}] 2023-07-20 07:12:04,224 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithMergeRegion-1' as deleted. 2023-07-20 07:12:04,224 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689837124224"}]},"ts":"9223372036854775807"} 2023-07-20 07:12:04,228 INFO [PEWorker-3] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithMergeRegion-1 state from META 2023-07-20 07:12:04,233 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(130): Finished pid=83, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-20 07:12:04,235 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=83, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 56 msec 2023-07-20 07:12:04,291 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] master.MasterRpcServices(1230): Checking to see if procedure is done pid=83 2023-07-20 07:12:04,291 INFO [Listener at jenkins-hbase4.apache.org/33837] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 83 completed 2023-07-20 07:12:04,292 INFO [Listener at jenkins-hbase4.apache.org/33837] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithMergeRegion 2023-07-20 07:12:04,292 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemStateWithMergeRegion 2023-07-20 07:12:04,294 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] procedure2.ProcedureExecutor(1029): Stored pid=84, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-20 07:12:04,297 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-07-20 07:12:04,297 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689837124297"}]},"ts":"1689837124297"} 2023-07-20 07:12:04,299 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=DISABLING in hbase:meta 2023-07-20 07:12:04,301 INFO [PEWorker-1] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithMergeRegion to state=DISABLING 2023-07-20 07:12:04,302 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=85, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=7d2b0a3e96cd9a8c2702f7abb84fdddb, UNASSIGN}, {pid=86, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=e4d8af6d8f4af1788629d227b0d2d3e6, UNASSIGN}] 2023-07-20 07:12:04,304 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=86, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=e4d8af6d8f4af1788629d227b0d2d3e6, UNASSIGN 2023-07-20 07:12:04,305 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=85, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=7d2b0a3e96cd9a8c2702f7abb84fdddb, UNASSIGN 2023-07-20 07:12:04,305 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=86 updating hbase:meta row=e4d8af6d8f4af1788629d227b0d2d3e6, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,44777,1689837020621 2023-07-20 07:12:04,306 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=85 updating hbase:meta row=7d2b0a3e96cd9a8c2702f7abb84fdddb, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,45099,1689837020733 2023-07-20 07:12:04,306 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689837103416.e4d8af6d8f4af1788629d227b0d2d3e6.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689837124305"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689837124305"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689837124305"}]},"ts":"1689837124305"} 2023-07-20 07:12:04,306 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689837103416.7d2b0a3e96cd9a8c2702f7abb84fdddb.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689837124305"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689837124305"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689837124305"}]},"ts":"1689837124305"} 2023-07-20 07:12:04,307 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=87, ppid=86, state=RUNNABLE; CloseRegionProcedure e4d8af6d8f4af1788629d227b0d2d3e6, server=jenkins-hbase4.apache.org,44777,1689837020621}] 2023-07-20 07:12:04,308 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=88, ppid=85, state=RUNNABLE; CloseRegionProcedure 7d2b0a3e96cd9a8c2702f7abb84fdddb, server=jenkins-hbase4.apache.org,45099,1689837020733}] 2023-07-20 07:12:04,399 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-07-20 07:12:04,459 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close e4d8af6d8f4af1788629d227b0d2d3e6 2023-07-20 07:12:04,459 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 7d2b0a3e96cd9a8c2702f7abb84fdddb 2023-07-20 07:12:04,460 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing e4d8af6d8f4af1788629d227b0d2d3e6, disabling compactions & flushes 2023-07-20 07:12:04,460 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 7d2b0a3e96cd9a8c2702f7abb84fdddb, disabling compactions & flushes 2023-07-20 07:12:04,460 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,1,1689837103416.e4d8af6d8f4af1788629d227b0d2d3e6. 2023-07-20 07:12:04,460 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,,1689837103416.7d2b0a3e96cd9a8c2702f7abb84fdddb. 2023-07-20 07:12:04,460 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1689837103416.e4d8af6d8f4af1788629d227b0d2d3e6. 2023-07-20 07:12:04,460 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,,1689837103416.7d2b0a3e96cd9a8c2702f7abb84fdddb. 2023-07-20 07:12:04,460 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1689837103416.e4d8af6d8f4af1788629d227b0d2d3e6. after waiting 0 ms 2023-07-20 07:12:04,460 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,1,1689837103416.e4d8af6d8f4af1788629d227b0d2d3e6. 2023-07-20 07:12:04,460 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,,1689837103416.7d2b0a3e96cd9a8c2702f7abb84fdddb. after waiting 0 ms 2023-07-20 07:12:04,460 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,,1689837103416.7d2b0a3e96cd9a8c2702f7abb84fdddb. 2023-07-20 07:12:04,484 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/data/default/testtb-testExportFileSystemStateWithMergeRegion/7d2b0a3e96cd9a8c2702f7abb84fdddb/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-20 07:12:04,484 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-20 07:12:04,486 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/data/default/testtb-testExportFileSystemStateWithMergeRegion/e4d8af6d8f4af1788629d227b0d2d3e6/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-20 07:12:04,486 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,,1689837103416.7d2b0a3e96cd9a8c2702f7abb84fdddb. 2023-07-20 07:12:04,486 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 7d2b0a3e96cd9a8c2702f7abb84fdddb: 2023-07-20 07:12:04,487 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-20 07:12:04,489 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,1,1689837103416.e4d8af6d8f4af1788629d227b0d2d3e6. 2023-07-20 07:12:04,489 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for e4d8af6d8f4af1788629d227b0d2d3e6: 2023-07-20 07:12:04,492 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 7d2b0a3e96cd9a8c2702f7abb84fdddb 2023-07-20 07:12:04,493 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=85 updating hbase:meta row=7d2b0a3e96cd9a8c2702f7abb84fdddb, regionState=CLOSED 2023-07-20 07:12:04,493 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689837103416.7d2b0a3e96cd9a8c2702f7abb84fdddb.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689837124493"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689837124493"}]},"ts":"1689837124493"} 2023-07-20 07:12:04,493 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed e4d8af6d8f4af1788629d227b0d2d3e6 2023-07-20 07:12:04,493 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=86 updating hbase:meta row=e4d8af6d8f4af1788629d227b0d2d3e6, regionState=CLOSED 2023-07-20 07:12:04,493 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689837103416.e4d8af6d8f4af1788629d227b0d2d3e6.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689837124493"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689837124493"}]},"ts":"1689837124493"} 2023-07-20 07:12:04,501 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=88, resume processing ppid=85 2023-07-20 07:12:04,501 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=88, ppid=85, state=SUCCESS; CloseRegionProcedure 7d2b0a3e96cd9a8c2702f7abb84fdddb, server=jenkins-hbase4.apache.org,45099,1689837020733 in 191 msec 2023-07-20 07:12:04,502 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=87, resume processing ppid=86 2023-07-20 07:12:04,502 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=87, ppid=86, state=SUCCESS; CloseRegionProcedure e4d8af6d8f4af1788629d227b0d2d3e6, server=jenkins-hbase4.apache.org,44777,1689837020621 in 193 msec 2023-07-20 07:12:04,502 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=85, ppid=84, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=7d2b0a3e96cd9a8c2702f7abb84fdddb, UNASSIGN in 199 msec 2023-07-20 07:12:04,504 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=86, resume processing ppid=84 2023-07-20 07:12:04,504 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=86, ppid=84, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=e4d8af6d8f4af1788629d227b0d2d3e6, UNASSIGN in 200 msec 2023-07-20 07:12:04,505 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689837124505"}]},"ts":"1689837124505"} 2023-07-20 07:12:04,506 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=DISABLED in hbase:meta 2023-07-20 07:12:04,508 INFO [PEWorker-5] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithMergeRegion to state=DISABLED 2023-07-20 07:12:04,510 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=84, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 215 msec 2023-07-20 07:12:04,600 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-07-20 07:12:04,600 INFO [Listener at jenkins-hbase4.apache.org/33837] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 84 completed 2023-07-20 07:12:04,601 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemStateWithMergeRegion 2023-07-20 07:12:04,602 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] procedure2.ProcedureExecutor(1029): Stored pid=89, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-20 07:12:04,605 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=89, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-20 07:12:04,605 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithMergeRegion 2023-07-20 07:12:04,606 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=89, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-20 07:12:04,607 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=44955] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithMergeRegion 2023-07-20 07:12:04,611 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/7d2b0a3e96cd9a8c2702f7abb84fdddb 2023-07-20 07:12:04,611 DEBUG [HFileArchiver-16] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/e4d8af6d8f4af1788629d227b0d2d3e6 2023-07-20 07:12:04,612 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): regionserver:44955-0x10181911f0f0003, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-20 07:12:04,612 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): regionserver:45099-0x10181911f0f0002, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-20 07:12:04,612 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): master:37415-0x10181911f0f0000, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-20 07:12:04,612 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): regionserver:44777-0x10181911f0f0001, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-20 07:12:04,612 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-07-20 07:12:04,613 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-07-20 07:12:04,613 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-07-20 07:12:04,613 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-07-20 07:12:04,614 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): regionserver:44955-0x10181911f0f0003, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-20 07:12:04,614 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): regionserver:44955-0x10181911f0f0003, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-20 07:12:04,614 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): master:37415-0x10181911f0f0000, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-20 07:12:04,614 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): master:37415-0x10181911f0f0000, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-20 07:12:04,614 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): regionserver:44777-0x10181911f0f0001, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-20 07:12:04,614 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): regionserver:44777-0x10181911f0f0001, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-20 07:12:04,615 DEBUG [HFileArchiver-16] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/e4d8af6d8f4af1788629d227b0d2d3e6/cf, FileablePath, hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/e4d8af6d8f4af1788629d227b0d2d3e6/recovered.edits] 2023-07-20 07:12:04,614 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): regionserver:45099-0x10181911f0f0002, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-20 07:12:04,615 DEBUG [HFileArchiver-14] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/7d2b0a3e96cd9a8c2702f7abb84fdddb/cf, FileablePath, hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/7d2b0a3e96cd9a8c2702f7abb84fdddb/recovered.edits] 2023-07-20 07:12:04,615 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): regionserver:45099-0x10181911f0f0002, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-20 07:12:04,616 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] master.MasterRpcServices(1230): Checking to see if procedure is done pid=89 2023-07-20 07:12:04,620 DEBUG [HFileArchiver-16] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/e4d8af6d8f4af1788629d227b0d2d3e6/cf/ef13dd536f7b4fafacbc8298917ffe69 to hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/e4d8af6d8f4af1788629d227b0d2d3e6/cf/ef13dd536f7b4fafacbc8298917ffe69 2023-07-20 07:12:04,620 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/7d2b0a3e96cd9a8c2702f7abb84fdddb/cf/fe36267d88204b33a44d6481310ecf6c to hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/7d2b0a3e96cd9a8c2702f7abb84fdddb/cf/fe36267d88204b33a44d6481310ecf6c 2023-07-20 07:12:04,624 DEBUG [HFileArchiver-16] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/e4d8af6d8f4af1788629d227b0d2d3e6/recovered.edits/9.seqid to hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/e4d8af6d8f4af1788629d227b0d2d3e6/recovered.edits/9.seqid 2023-07-20 07:12:04,625 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/7d2b0a3e96cd9a8c2702f7abb84fdddb/recovered.edits/9.seqid to hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/7d2b0a3e96cd9a8c2702f7abb84fdddb/recovered.edits/9.seqid 2023-07-20 07:12:04,625 DEBUG [HFileArchiver-16] backup.HFileArchiver(596): Deleted hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/e4d8af6d8f4af1788629d227b0d2d3e6 2023-07-20 07:12:04,625 DEBUG [HFileArchiver-14] backup.HFileArchiver(596): Deleted hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/7d2b0a3e96cd9a8c2702f7abb84fdddb 2023-07-20 07:12:04,625 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion regions 2023-07-20 07:12:04,626 DEBUG [PEWorker-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c 2023-07-20 07:12:04,627 DEBUG [PEWorker-1] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf] 2023-07-20 07:12:04,634 DEBUG [PEWorker-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b2023072076c080b256b1462f83b05a08e0e6cd47 to hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b2023072076c080b256b1462f83b05a08e0e6cd47 2023-07-20 07:12:04,635 DEBUG [PEWorker-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e202307201bc4454c4f37429db8fe3682beba7cc4 to hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e202307201bc4454c4f37429db8fe3682beba7cc4 2023-07-20 07:12:04,636 DEBUG [PEWorker-1] backup.HFileArchiver(596): Deleted hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c 2023-07-20 07:12:04,638 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=89, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-20 07:12:04,641 WARN [PEWorker-1] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemStateWithMergeRegion from hbase:meta 2023-07-20 07:12:04,644 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithMergeRegion' descriptor. 2023-07-20 07:12:04,647 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=89, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-20 07:12:04,647 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithMergeRegion' from region states. 2023-07-20 07:12:04,647 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689837103416.7d2b0a3e96cd9a8c2702f7abb84fdddb.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689837124647"}]},"ts":"9223372036854775807"} 2023-07-20 07:12:04,648 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689837103416.e4d8af6d8f4af1788629d227b0d2d3e6.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689837124647"}]},"ts":"9223372036854775807"} 2023-07-20 07:12:04,650 INFO [PEWorker-1] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-20 07:12:04,650 DEBUG [PEWorker-1] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 7d2b0a3e96cd9a8c2702f7abb84fdddb, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1689837103416.7d2b0a3e96cd9a8c2702f7abb84fdddb.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => e4d8af6d8f4af1788629d227b0d2d3e6, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1689837103416.e4d8af6d8f4af1788629d227b0d2d3e6.', STARTKEY => '1', ENDKEY => ''}] 2023-07-20 07:12:04,650 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithMergeRegion' as deleted. 2023-07-20 07:12:04,650 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689837124650"}]},"ts":"9223372036854775807"} 2023-07-20 07:12:04,651 INFO [PEWorker-1] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithMergeRegion state from META 2023-07-20 07:12:04,654 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(130): Finished pid=89, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-20 07:12:04,655 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=89, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 53 msec 2023-07-20 07:12:04,717 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] master.MasterRpcServices(1230): Checking to see if procedure is done pid=89 2023-07-20 07:12:04,717 INFO [Listener at jenkins-hbase4.apache.org/33837] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 89 completed 2023-07-20 07:12:04,729 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportFileSystemStateWithMergeRegion" 2023-07-20 07:12:04,731 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 07:12:04,732 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemStateWithMergeRegion" 2023-07-20 07:12:04,735 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 07:12:04,737 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemStateWithMergeRegion-1" 2023-07-20 07:12:04,739 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 07:12:04,770 INFO [Listener at jenkins-hbase4.apache.org/33837] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithMergeRegion Thread=758 (was 745) Potentially hanging thread: hconnection-0x7a39bf3a-shared-pool-31 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-15 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #7 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-20 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x7a39bf3a-shared-pool-33 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_759529442_17 at /127.0.0.1:36226 [Waiting for operation #7] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-18 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x7a39bf3a-shared-pool-32 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-5 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_759529442_17 at /127.0.0.1:47936 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x7a39bf3a-shared-pool-30 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_424892068_1 at /127.0.0.1:36218 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-17 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_424892068_1 at /127.0.0.1:46424 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x7a39bf3a-shared-pool-29 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-4107 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-6 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-19 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x7a39bf3a-shared-pool-28 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-16 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_759529442_17 at /127.0.0.1:46450 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Parameter Sending Thread #3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #8 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-7 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (309353702) connection to jenkins-hbase4.apache.org/172.31.14.131:43425 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) - Thread LEAK? -, OpenFileDescriptor=904 (was 897) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=533 (was 430) - SystemLoadAverage LEAK? -, ProcessCount=184 (was 185), AvailableMemoryMB=2054 (was 2388) 2023-07-20 07:12:04,770 WARN [Listener at jenkins-hbase4.apache.org/33837] hbase.ResourceChecker(130): Thread=758 is superior to 500 2023-07-20 07:12:04,801 INFO [Listener at jenkins-hbase4.apache.org/33837] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testEmptyExportFileSystemState Thread=758, OpenFileDescriptor=904, MaxFileDescriptor=60000, SystemLoadAverage=533, ProcessCount=184, AvailableMemoryMB=2053 2023-07-20 07:12:04,801 WARN [Listener at jenkins-hbase4.apache.org/33837] hbase.ResourceChecker(130): Thread=758 is superior to 500 2023-07-20 07:12:04,803 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-07-20 07:12:04,804 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] procedure2.ProcedureExecutor(1029): Stored pid=90, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-20 07:12:04,807 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_PRE_OPERATION 2023-07-20 07:12:04,808 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testEmptyExportFileSystemState" procId is: 90 2023-07-20 07:12:04,809 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-20 07:12:04,809 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-20 07:12:04,812 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/.tmp/data/default/testtb-testEmptyExportFileSystemState/92a00c925bbc0b2fd5b0b5900d64b365 2023-07-20 07:12:04,812 DEBUG [HFileArchiver-17] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/.tmp/data/default/testtb-testEmptyExportFileSystemState/cc1a31b2c1bbb19255945e06eefa045b 2023-07-20 07:12:04,814 DEBUG [HFileArchiver-15] backup.HFileArchiver(153): Directory hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/.tmp/data/default/testtb-testEmptyExportFileSystemState/92a00c925bbc0b2fd5b0b5900d64b365 empty. 2023-07-20 07:12:04,817 DEBUG [HFileArchiver-17] backup.HFileArchiver(153): Directory hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/.tmp/data/default/testtb-testEmptyExportFileSystemState/cc1a31b2c1bbb19255945e06eefa045b empty. 2023-07-20 07:12:04,817 DEBUG [HFileArchiver-15] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/.tmp/data/default/testtb-testEmptyExportFileSystemState/92a00c925bbc0b2fd5b0b5900d64b365 2023-07-20 07:12:04,817 DEBUG [HFileArchiver-17] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/.tmp/data/default/testtb-testEmptyExportFileSystemState/cc1a31b2c1bbb19255945e06eefa045b 2023-07-20 07:12:04,817 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testEmptyExportFileSystemState regions 2023-07-20 07:12:04,857 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/.tmp/data/default/testtb-testEmptyExportFileSystemState/.tabledesc/.tableinfo.0000000001 2023-07-20 07:12:04,859 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(7675): creating {ENCODED => cc1a31b2c1bbb19255945e06eefa045b, NAME => 'testtb-testEmptyExportFileSystemState,1,1689837124803.cc1a31b2c1bbb19255945e06eefa045b.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/.tmp 2023-07-20 07:12:04,859 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(7675): creating {ENCODED => 92a00c925bbc0b2fd5b0b5900d64b365, NAME => 'testtb-testEmptyExportFileSystemState,,1689837124803.92a00c925bbc0b2fd5b0b5900d64b365.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/.tmp 2023-07-20 07:12:04,911 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-20 07:12:05,112 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-20 07:12:05,293 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,1,1689837124803.cc1a31b2c1bbb19255945e06eefa045b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-20 07:12:05,293 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1604): Closing cc1a31b2c1bbb19255945e06eefa045b, disabling compactions & flushes 2023-07-20 07:12:05,293 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,1,1689837124803.cc1a31b2c1bbb19255945e06eefa045b. 2023-07-20 07:12:05,294 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,1,1689837124803.cc1a31b2c1bbb19255945e06eefa045b. 2023-07-20 07:12:05,294 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,1,1689837124803.cc1a31b2c1bbb19255945e06eefa045b. after waiting 0 ms 2023-07-20 07:12:05,294 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,1,1689837124803.cc1a31b2c1bbb19255945e06eefa045b. 2023-07-20 07:12:05,294 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,1,1689837124803.cc1a31b2c1bbb19255945e06eefa045b. 2023-07-20 07:12:05,294 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1558): Region close journal for cc1a31b2c1bbb19255945e06eefa045b: 2023-07-20 07:12:05,295 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,,1689837124803.92a00c925bbc0b2fd5b0b5900d64b365.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-20 07:12:05,295 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1604): Closing 92a00c925bbc0b2fd5b0b5900d64b365, disabling compactions & flushes 2023-07-20 07:12:05,295 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,,1689837124803.92a00c925bbc0b2fd5b0b5900d64b365. 2023-07-20 07:12:05,295 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,,1689837124803.92a00c925bbc0b2fd5b0b5900d64b365. 2023-07-20 07:12:05,295 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,,1689837124803.92a00c925bbc0b2fd5b0b5900d64b365. after waiting 0 ms 2023-07-20 07:12:05,295 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,,1689837124803.92a00c925bbc0b2fd5b0b5900d64b365. 2023-07-20 07:12:05,295 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,,1689837124803.92a00c925bbc0b2fd5b0b5900d64b365. 2023-07-20 07:12:05,295 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1558): Region close journal for 92a00c925bbc0b2fd5b0b5900d64b365: 2023-07-20 07:12:05,297 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_ADD_TO_META 2023-07-20 07:12:05,298 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,1,1689837124803.cc1a31b2c1bbb19255945e06eefa045b.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689837125298"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689837125298"}]},"ts":"1689837125298"} 2023-07-20 07:12:05,298 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,,1689837124803.92a00c925bbc0b2fd5b0b5900d64b365.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689837125298"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689837125298"}]},"ts":"1689837125298"} 2023-07-20 07:12:05,300 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-20 07:12:05,301 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-20 07:12:05,301 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689837125301"}]},"ts":"1689837125301"} 2023-07-20 07:12:05,303 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=ENABLING in hbase:meta 2023-07-20 07:12:05,306 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-20 07:12:05,307 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-20 07:12:05,307 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-20 07:12:05,307 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-20 07:12:05,307 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-20 07:12:05,308 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=92a00c925bbc0b2fd5b0b5900d64b365, ASSIGN}, {pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=cc1a31b2c1bbb19255945e06eefa045b, ASSIGN}] 2023-07-20 07:12:05,313 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=cc1a31b2c1bbb19255945e06eefa045b, ASSIGN 2023-07-20 07:12:05,313 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=92a00c925bbc0b2fd5b0b5900d64b365, ASSIGN 2023-07-20 07:12:05,314 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=cc1a31b2c1bbb19255945e06eefa045b, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,45099,1689837020733; forceNewPlan=false, retain=false 2023-07-20 07:12:05,315 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=92a00c925bbc0b2fd5b0b5900d64b365, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,44777,1689837020621; forceNewPlan=false, retain=false 2023-07-20 07:12:05,414 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-20 07:12:05,465 INFO [jenkins-hbase4:37415] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-20 07:12:05,467 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=92 updating hbase:meta row=cc1a31b2c1bbb19255945e06eefa045b, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,45099,1689837020733 2023-07-20 07:12:05,467 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=92a00c925bbc0b2fd5b0b5900d64b365, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,44777,1689837020621 2023-07-20 07:12:05,468 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,1,1689837124803.cc1a31b2c1bbb19255945e06eefa045b.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689837125467"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689837125467"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689837125467"}]},"ts":"1689837125467"} 2023-07-20 07:12:05,468 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,,1689837124803.92a00c925bbc0b2fd5b0b5900d64b365.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689837125467"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689837125467"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689837125467"}]},"ts":"1689837125467"} 2023-07-20 07:12:05,469 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=93, ppid=92, state=RUNNABLE; OpenRegionProcedure cc1a31b2c1bbb19255945e06eefa045b, server=jenkins-hbase4.apache.org,45099,1689837020733}] 2023-07-20 07:12:05,470 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=94, ppid=91, state=RUNNABLE; OpenRegionProcedure 92a00c925bbc0b2fd5b0b5900d64b365, server=jenkins-hbase4.apache.org,44777,1689837020621}] 2023-07-20 07:12:05,624 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testEmptyExportFileSystemState,,1689837124803.92a00c925bbc0b2fd5b0b5900d64b365. 2023-07-20 07:12:05,624 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testEmptyExportFileSystemState,1,1689837124803.cc1a31b2c1bbb19255945e06eefa045b. 2023-07-20 07:12:05,624 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 92a00c925bbc0b2fd5b0b5900d64b365, NAME => 'testtb-testEmptyExportFileSystemState,,1689837124803.92a00c925bbc0b2fd5b0b5900d64b365.', STARTKEY => '', ENDKEY => '1'} 2023-07-20 07:12:05,625 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => cc1a31b2c1bbb19255945e06eefa045b, NAME => 'testtb-testEmptyExportFileSystemState,1,1689837124803.cc1a31b2c1bbb19255945e06eefa045b.', STARTKEY => '1', ENDKEY => ''} 2023-07-20 07:12:05,625 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testEmptyExportFileSystemState,1,1689837124803.cc1a31b2c1bbb19255945e06eefa045b. service=AccessControlService 2023-07-20 07:12:05,625 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testEmptyExportFileSystemState,,1689837124803.92a00c925bbc0b2fd5b0b5900d64b365. service=AccessControlService 2023-07-20 07:12:05,625 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-20 07:12:05,625 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-20 07:12:05,625 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testEmptyExportFileSystemState cc1a31b2c1bbb19255945e06eefa045b 2023-07-20 07:12:05,625 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testEmptyExportFileSystemState 92a00c925bbc0b2fd5b0b5900d64b365 2023-07-20 07:12:05,625 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,1,1689837124803.cc1a31b2c1bbb19255945e06eefa045b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-20 07:12:05,625 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,,1689837124803.92a00c925bbc0b2fd5b0b5900d64b365.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-20 07:12:05,625 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for cc1a31b2c1bbb19255945e06eefa045b 2023-07-20 07:12:05,625 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for cc1a31b2c1bbb19255945e06eefa045b 2023-07-20 07:12:05,625 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 92a00c925bbc0b2fd5b0b5900d64b365 2023-07-20 07:12:05,626 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 92a00c925bbc0b2fd5b0b5900d64b365 2023-07-20 07:12:05,627 INFO [StoreOpener-92a00c925bbc0b2fd5b0b5900d64b365-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 92a00c925bbc0b2fd5b0b5900d64b365 2023-07-20 07:12:05,627 INFO [StoreOpener-cc1a31b2c1bbb19255945e06eefa045b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region cc1a31b2c1bbb19255945e06eefa045b 2023-07-20 07:12:05,629 DEBUG [StoreOpener-cc1a31b2c1bbb19255945e06eefa045b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/data/default/testtb-testEmptyExportFileSystemState/cc1a31b2c1bbb19255945e06eefa045b/cf 2023-07-20 07:12:05,629 DEBUG [StoreOpener-cc1a31b2c1bbb19255945e06eefa045b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/data/default/testtb-testEmptyExportFileSystemState/cc1a31b2c1bbb19255945e06eefa045b/cf 2023-07-20 07:12:05,630 INFO [StoreOpener-cc1a31b2c1bbb19255945e06eefa045b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region cc1a31b2c1bbb19255945e06eefa045b columnFamilyName cf 2023-07-20 07:12:05,632 DEBUG [StoreOpener-92a00c925bbc0b2fd5b0b5900d64b365-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/data/default/testtb-testEmptyExportFileSystemState/92a00c925bbc0b2fd5b0b5900d64b365/cf 2023-07-20 07:12:05,632 INFO [StoreOpener-cc1a31b2c1bbb19255945e06eefa045b-1] regionserver.HStore(310): Store=cc1a31b2c1bbb19255945e06eefa045b/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-20 07:12:05,632 DEBUG [StoreOpener-92a00c925bbc0b2fd5b0b5900d64b365-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/data/default/testtb-testEmptyExportFileSystemState/92a00c925bbc0b2fd5b0b5900d64b365/cf 2023-07-20 07:12:05,632 INFO [StoreOpener-92a00c925bbc0b2fd5b0b5900d64b365-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 92a00c925bbc0b2fd5b0b5900d64b365 columnFamilyName cf 2023-07-20 07:12:05,633 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/data/default/testtb-testEmptyExportFileSystemState/cc1a31b2c1bbb19255945e06eefa045b 2023-07-20 07:12:05,633 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/data/default/testtb-testEmptyExportFileSystemState/cc1a31b2c1bbb19255945e06eefa045b 2023-07-20 07:12:05,633 INFO [StoreOpener-92a00c925bbc0b2fd5b0b5900d64b365-1] regionserver.HStore(310): Store=92a00c925bbc0b2fd5b0b5900d64b365/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-20 07:12:05,634 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/data/default/testtb-testEmptyExportFileSystemState/92a00c925bbc0b2fd5b0b5900d64b365 2023-07-20 07:12:05,635 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/data/default/testtb-testEmptyExportFileSystemState/92a00c925bbc0b2fd5b0b5900d64b365 2023-07-20 07:12:05,636 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for cc1a31b2c1bbb19255945e06eefa045b 2023-07-20 07:12:05,641 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 92a00c925bbc0b2fd5b0b5900d64b365 2023-07-20 07:12:05,649 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/data/default/testtb-testEmptyExportFileSystemState/cc1a31b2c1bbb19255945e06eefa045b/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-20 07:12:05,649 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/data/default/testtb-testEmptyExportFileSystemState/92a00c925bbc0b2fd5b0b5900d64b365/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-20 07:12:05,649 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened cc1a31b2c1bbb19255945e06eefa045b; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65378961, jitterRate=-0.025777563452720642}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-20 07:12:05,649 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for cc1a31b2c1bbb19255945e06eefa045b: 2023-07-20 07:12:05,650 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 92a00c925bbc0b2fd5b0b5900d64b365; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=58862948, jitterRate=-0.12287372350692749}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-20 07:12:05,650 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 92a00c925bbc0b2fd5b0b5900d64b365: 2023-07-20 07:12:05,650 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testEmptyExportFileSystemState,,1689837124803.92a00c925bbc0b2fd5b0b5900d64b365., pid=94, masterSystemTime=1689837125621 2023-07-20 07:12:05,650 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testEmptyExportFileSystemState,1,1689837124803.cc1a31b2c1bbb19255945e06eefa045b., pid=93, masterSystemTime=1689837125621 2023-07-20 07:12:05,653 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testEmptyExportFileSystemState,,1689837124803.92a00c925bbc0b2fd5b0b5900d64b365. 2023-07-20 07:12:05,653 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testEmptyExportFileSystemState,,1689837124803.92a00c925bbc0b2fd5b0b5900d64b365. 2023-07-20 07:12:05,653 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=92a00c925bbc0b2fd5b0b5900d64b365, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,44777,1689837020621 2023-07-20 07:12:05,653 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testEmptyExportFileSystemState,,1689837124803.92a00c925bbc0b2fd5b0b5900d64b365.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689837125653"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689837125653"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689837125653"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689837125653"}]},"ts":"1689837125653"} 2023-07-20 07:12:05,654 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testEmptyExportFileSystemState,1,1689837124803.cc1a31b2c1bbb19255945e06eefa045b. 2023-07-20 07:12:05,654 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testEmptyExportFileSystemState,1,1689837124803.cc1a31b2c1bbb19255945e06eefa045b. 2023-07-20 07:12:05,654 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=92 updating hbase:meta row=cc1a31b2c1bbb19255945e06eefa045b, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,45099,1689837020733 2023-07-20 07:12:05,655 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testEmptyExportFileSystemState,1,1689837124803.cc1a31b2c1bbb19255945e06eefa045b.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689837125654"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689837125654"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689837125654"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689837125654"}]},"ts":"1689837125654"} 2023-07-20 07:12:05,659 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=94, resume processing ppid=91 2023-07-20 07:12:05,659 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=94, ppid=91, state=SUCCESS; OpenRegionProcedure 92a00c925bbc0b2fd5b0b5900d64b365, server=jenkins-hbase4.apache.org,44777,1689837020621 in 186 msec 2023-07-20 07:12:05,663 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=93, resume processing ppid=92 2023-07-20 07:12:05,663 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=93, ppid=92, state=SUCCESS; OpenRegionProcedure cc1a31b2c1bbb19255945e06eefa045b, server=jenkins-hbase4.apache.org,45099,1689837020733 in 188 msec 2023-07-20 07:12:05,664 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=91, ppid=90, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=92a00c925bbc0b2fd5b0b5900d64b365, ASSIGN in 351 msec 2023-07-20 07:12:05,668 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=92, resume processing ppid=90 2023-07-20 07:12:05,668 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=92, ppid=90, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=cc1a31b2c1bbb19255945e06eefa045b, ASSIGN in 355 msec 2023-07-20 07:12:05,669 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-20 07:12:05,669 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689837125669"}]},"ts":"1689837125669"} 2023-07-20 07:12:05,671 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=ENABLED in hbase:meta 2023-07-20 07:12:05,674 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_POST_OPERATION 2023-07-20 07:12:05,674 DEBUG [PEWorker-5] access.PermissionStorage(175): Writing permission with rowKey testtb-testEmptyExportFileSystemState jenkins: RWXCA 2023-07-20 07:12:05,677 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=44955] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-07-20 07:12:05,678 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): master:37415-0x10181911f0f0000, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-20 07:12:05,678 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): regionserver:44777-0x10181911f0f0001, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-20 07:12:05,678 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): regionserver:45099-0x10181911f0f0002, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-20 07:12:05,680 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): regionserver:44955-0x10181911f0f0003, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-20 07:12:05,682 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): regionserver:44777-0x10181911f0f0001, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-20 07:12:05,682 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): master:37415-0x10181911f0f0000, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-20 07:12:05,682 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): regionserver:45099-0x10181911f0f0002, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-20 07:12:05,683 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-20 07:12:05,683 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-20 07:12:05,683 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-20 07:12:05,683 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-20 07:12:05,685 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=90, state=SUCCESS; CreateTableProcedure table=testtb-testEmptyExportFileSystemState in 879 msec 2023-07-20 07:12:05,915 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-20 07:12:05,915 INFO [Listener at jenkins-hbase4.apache.org/33837] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 90 completed 2023-07-20 07:12:05,918 DEBUG [Listener at jenkins-hbase4.apache.org/33837] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testEmptyExportFileSystemState 2023-07-20 07:12:05,918 DEBUG [Listener at jenkins-hbase4.apache.org/33837] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testEmptyExportFileSystemState,,1689837124803.92a00c925bbc0b2fd5b0b5900d64b365. 2023-07-20 07:12:05,920 INFO [Listener at jenkins-hbase4.apache.org/33837] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-20 07:12:05,938 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-20 07:12:05,938 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689837125938 (current time:1689837125938). 2023-07-20 07:12:05,938 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-20 07:12:05,939 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] zookeeper.ReadOnlyZKClient(139): Connect 0x275ac6ca to 127.0.0.1:58010 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-20 07:12:05,951 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@68fef4e2, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-20 07:12:05,956 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-20 07:12:05,957 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:55694, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-20 07:12:05,959 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x275ac6ca to 127.0.0.1:58010 2023-07-20 07:12:05,959 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-20 07:12:05,959 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] zookeeper.ReadOnlyZKClient(139): Connect 0x2cd7d7c2 to 127.0.0.1:58010 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-20 07:12:05,974 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5d4a2804, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-20 07:12:05,976 DEBUG [hconnection-0x420c8eab-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-20 07:12:05,979 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:55702, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-20 07:12:05,983 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-20 07:12:05,985 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:46732, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-20 07:12:05,987 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2cd7d7c2 to 127.0.0.1:58010 2023-07-20 07:12:05,987 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-20 07:12:05,987 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-07-20 07:12:05,988 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-20 07:12:05,988 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-20 07:12:05,990 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] procedure2.ProcedureExecutor(1029): Stored pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-20 07:12:05,991 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-20 07:12:05,992 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=95, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1689837725992 2023-07-20 07:12:05,992 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-20 07:12:05,992 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState 2023-07-20 07:12:05,993 DEBUG [Listener at jenkins-hbase4.apache.org/33837] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-20 07:12:05,993 DEBUG [Listener at jenkins-hbase4.apache.org/33837] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-20 07:12:05,994 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=95, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-20 07:12:05,994 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=96, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-20 07:12:05,995 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=95, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE in 5 msec 2023-07-20 07:12:05,998 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=96, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-20 07:12:05,999 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=96, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED; timeout=600000, timestamp=1689837725999 2023-07-20 07:12:06,019 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 07:12:06,019 INFO [(jenkins-hbase4.apache.org,37415,1689837019114)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testEmptyExportFileSystemState' 2023-07-20 07:12:06,019 DEBUG [(jenkins-hbase4.apache.org,37415,1689837019114)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-20 07:12:06,020 DEBUG [(jenkins-hbase4.apache.org,37415,1689837019114)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' 2023-07-20 07:12:06,020 DEBUG [(jenkins-hbase4.apache.org,37415,1689837019114)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testEmptyExportFileSystemState', kicking off acquire phase on members. 2023-07-20 07:12:06,021 DEBUG [(jenkins-hbase4.apache.org,37415,1689837019114)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37415-0x10181911f0f0000, quorum=127.0.0.1:58010, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 07:12:06,021 DEBUG [(jenkins-hbase4.apache.org,37415,1689837019114)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 07:12:06,024 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): regionserver:44777-0x10181911f0f0001, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 07:12:06,024 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): regionserver:45099-0x10181911f0f0002, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 07:12:06,024 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 07:12:06,024 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 07:12:06,024 DEBUG [(jenkins-hbase4.apache.org,37415,1689837019114)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,44777,1689837020621 2023-07-20 07:12:06,024 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): regionserver:44955-0x10181911f0f0003, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 07:12:06,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 07:12:06,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 07:12:06,025 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 07:12:06,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 07:12:06,025 DEBUG [(jenkins-hbase4.apache.org,37415,1689837019114)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37415-0x10181911f0f0000, quorum=127.0.0.1:58010, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,44777,1689837020621 2023-07-20 07:12:06,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 07:12:06,025 DEBUG [(jenkins-hbase4.apache.org,37415,1689837019114)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45099,1689837020733 2023-07-20 07:12:06,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 07:12:06,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 07:12:06,025 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45099-0x10181911f0f0002, quorum=127.0.0.1:58010, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 07:12:06,025 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44777-0x10181911f0f0001, quorum=127.0.0.1:58010, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 07:12:06,026 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44955-0x10181911f0f0003, quorum=127.0.0.1:58010, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 07:12:06,026 DEBUG [(jenkins-hbase4.apache.org,37415,1689837019114)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37415-0x10181911f0f0000, quorum=127.0.0.1:58010, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45099,1689837020733 2023-07-20 07:12:06,026 DEBUG [(jenkins-hbase4.apache.org,37415,1689837019114)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-20 07:12:06,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-07-20 07:12:06,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 07:12:06,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-07-20 07:12:06,027 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-20 07:12:06,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 07:12:06,027 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-20 07:12:06,027 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 07:12:06,027 DEBUG [member: 'jenkins-hbase4.apache.org,44777,1689837020621' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-20 07:12:06,027 DEBUG [member: 'jenkins-hbase4.apache.org,44777,1689837020621' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-20 07:12:06,032 DEBUG [member: 'jenkins-hbase4.apache.org,44777,1689837020621' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-20 07:12:06,032 DEBUG [member: 'jenkins-hbase4.apache.org,44777,1689837020621' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-20 07:12:06,032 DEBUG [member: 'jenkins-hbase4.apache.org,44777,1689837020621' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44777,1689837020621' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-07-20 07:12:06,032 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 07:12:06,032 DEBUG [member: 'jenkins-hbase4.apache.org,45099,1689837020733' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-20 07:12:06,032 DEBUG [member: 'jenkins-hbase4.apache.org,45099,1689837020733' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-20 07:12:06,034 DEBUG [member: 'jenkins-hbase4.apache.org,45099,1689837020733' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-20 07:12:06,034 DEBUG [member: 'jenkins-hbase4.apache.org,45099,1689837020733' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-20 07:12:06,034 DEBUG [member: 'jenkins-hbase4.apache.org,45099,1689837020733' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45099,1689837020733' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-07-20 07:12:06,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-07-20 07:12:06,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 07:12:06,035 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-20 07:12:06,035 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 07:12:06,035 DEBUG [member: 'jenkins-hbase4.apache.org,44955,1689837020792' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-20 07:12:06,035 DEBUG [member: 'jenkins-hbase4.apache.org,44955,1689837020792' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-20 07:12:06,036 DEBUG [member: 'jenkins-hbase4.apache.org,44955,1689837020792' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-20 07:12:06,036 DEBUG [member: 'jenkins-hbase4.apache.org,44955,1689837020792' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-20 07:12:06,036 DEBUG [member: 'jenkins-hbase4.apache.org,44955,1689837020792' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44955,1689837020792' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-07-20 07:12:06,037 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): master:37415-0x10181911f0f0000, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45099,1689837020733 2023-07-20 07:12:06,037 DEBUG [member: 'jenkins-hbase4.apache.org,45099,1689837020733' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 07:12:06,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45099,1689837020733 2023-07-20 07:12:06,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-20 07:12:06,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-20 07:12:06,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-20 07:12:06,037 DEBUG [member: 'jenkins-hbase4.apache.org,45099,1689837020733' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45099-0x10181911f0f0002, quorum=127.0.0.1:58010, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 07:12:06,037 DEBUG [member: 'jenkins-hbase4.apache.org,45099,1689837020733' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-20 07:12:06,039 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): master:37415-0x10181911f0f0000, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,44777,1689837020621 2023-07-20 07:12:06,039 DEBUG [member: 'jenkins-hbase4.apache.org,44777,1689837020621' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 07:12:06,040 DEBUG [member: 'jenkins-hbase4.apache.org,44955,1689837020792' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 07:12:06,040 DEBUG [member: 'jenkins-hbase4.apache.org,44777,1689837020621' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44777-0x10181911f0f0001, quorum=127.0.0.1:58010, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 07:12:06,040 DEBUG [member: 'jenkins-hbase4.apache.org,44777,1689837020621' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-20 07:12:06,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-20 07:12:06,040 DEBUG [member: 'jenkins-hbase4.apache.org,44955,1689837020792' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44955-0x10181911f0f0003, quorum=127.0.0.1:58010, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 07:12:06,041 DEBUG [member: 'jenkins-hbase4.apache.org,44955,1689837020792' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-20 07:12:06,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 07:12:06,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44955,1689837020792 2023-07-20 07:12:06,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44777,1689837020621 2023-07-20 07:12:06,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45099,1689837020733 2023-07-20 07:12:06,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-20 07:12:06,042 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,45099,1689837020733' joining acquired barrier for procedure 'emptySnaptb0-testEmptyExportFileSystemState' on coordinator 2023-07-20 07:12:06,042 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1a9b917c[Count = 1] remaining members to acquire global barrier 2023-07-20 07:12:06,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,44777,1689837020621 2023-07-20 07:12:06,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-20 07:12:06,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-20 07:12:06,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-20 07:12:06,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-20 07:12:06,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 07:12:06,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44955,1689837020792 2023-07-20 07:12:06,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44777,1689837020621 2023-07-20 07:12:06,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45099,1689837020733 2023-07-20 07:12:06,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-20 07:12:06,045 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44777,1689837020621' joining acquired barrier for procedure 'emptySnaptb0-testEmptyExportFileSystemState' on coordinator 2023-07-20 07:12:06,045 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1a9b917c[Count = 0] remaining members to acquire global barrier 2023-07-20 07:12:06,045 DEBUG [(jenkins-hbase4.apache.org,37415,1689837019114)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'in-barrier' execution. 2023-07-20 07:12:06,045 DEBUG [(jenkins-hbase4.apache.org,37415,1689837019114)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 07:12:06,046 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): regionserver:45099-0x10181911f0f0002, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 07:12:06,046 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): regionserver:44777-0x10181911f0f0001, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 07:12:06,047 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 07:12:06,046 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): regionserver:44955-0x10181911f0f0003, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 07:12:06,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 07:12:06,047 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 07:12:06,047 DEBUG [member: 'jenkins-hbase4.apache.org,45099,1689837020733' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-20 07:12:06,047 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 07:12:06,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 07:12:06,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 07:12:06,047 DEBUG [member: 'jenkins-hbase4.apache.org,44955,1689837020792' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-20 07:12:06,047 DEBUG [member: 'jenkins-hbase4.apache.org,45099,1689837020733' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-20 07:12:06,047 DEBUG [rs(jenkins-hbase4.apache.org,45099,1689837020733)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,1,1689837124803.cc1a31b2c1bbb19255945e06eefa045b. 2023-07-20 07:12:06,047 DEBUG [member: 'jenkins-hbase4.apache.org,45099,1689837020733' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-20 07:12:06,047 DEBUG [member: 'jenkins-hbase4.apache.org,44955,1689837020792' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-07-20 07:12:06,047 DEBUG [member: 'jenkins-hbase4.apache.org,44955,1689837020792' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,44955,1689837020792' in zk 2023-07-20 07:12:06,047 DEBUG [member: 'jenkins-hbase4.apache.org,44777,1689837020621' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-20 07:12:06,047 DEBUG [(jenkins-hbase4.apache.org,37415,1689837019114)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37415-0x10181911f0f0000, quorum=127.0.0.1:58010, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45099,1689837020733 2023-07-20 07:12:06,047 DEBUG [rs(jenkins-hbase4.apache.org,45099,1689837020733)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1689837124803.cc1a31b2c1bbb19255945e06eefa045b. started... 2023-07-20 07:12:06,048 DEBUG [(jenkins-hbase4.apache.org,37415,1689837019114)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37415-0x10181911f0f0000, quorum=127.0.0.1:58010, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,44777,1689837020621 2023-07-20 07:12:06,048 DEBUG [(jenkins-hbase4.apache.org,37415,1689837019114)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-20 07:12:06,049 DEBUG [member: 'jenkins-hbase4.apache.org,44955,1689837020792' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-20 07:12:06,049 DEBUG [member: 'jenkins-hbase4.apache.org,44955,1689837020792' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-20 07:12:06,049 DEBUG [member: 'jenkins-hbase4.apache.org,44955,1689837020792' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-07-20 07:12:06,054 DEBUG [member: 'jenkins-hbase4.apache.org,44777,1689837020621' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-20 07:12:06,056 DEBUG [rs(jenkins-hbase4.apache.org,45099,1689837020733)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for cc1a31b2c1bbb19255945e06eefa045b: 2023-07-20 07:12:06,056 DEBUG [rs(jenkins-hbase4.apache.org,44777,1689837020621)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,,1689837124803.92a00c925bbc0b2fd5b0b5900d64b365. 2023-07-20 07:12:06,056 DEBUG [member: 'jenkins-hbase4.apache.org,44777,1689837020621' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-20 07:12:06,056 DEBUG [rs(jenkins-hbase4.apache.org,44777,1689837020621)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1689837124803.92a00c925bbc0b2fd5b0b5900d64b365. started... 2023-07-20 07:12:06,057 DEBUG [rs(jenkins-hbase4.apache.org,45099,1689837020733)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,1,1689837124803.cc1a31b2c1bbb19255945e06eefa045b.' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 07:12:06,057 DEBUG [rs(jenkins-hbase4.apache.org,45099,1689837020733)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-20 07:12:06,057 DEBUG [rs(jenkins-hbase4.apache.org,44777,1689837020621)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 92a00c925bbc0b2fd5b0b5900d64b365: 2023-07-20 07:12:06,057 DEBUG [rs(jenkins-hbase4.apache.org,45099,1689837020733)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-20 07:12:06,057 DEBUG [rs(jenkins-hbase4.apache.org,44777,1689837020621)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,,1689837124803.92a00c925bbc0b2fd5b0b5900d64b365.' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 07:12:06,057 DEBUG [rs(jenkins-hbase4.apache.org,44777,1689837020621)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-20 07:12:06,057 DEBUG [rs(jenkins-hbase4.apache.org,44777,1689837020621)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-20 07:12:06,077 DEBUG [rs(jenkins-hbase4.apache.org,44777,1689837020621)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1689837124803.92a00c925bbc0b2fd5b0b5900d64b365. completed. 2023-07-20 07:12:06,077 DEBUG [rs(jenkins-hbase4.apache.org,44777,1689837020621)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,,1689837124803.92a00c925bbc0b2fd5b0b5900d64b365. 2023-07-20 07:12:06,077 DEBUG [member: 'jenkins-hbase4.apache.org,44777,1689837020621' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-20 07:12:06,077 DEBUG [member: 'jenkins-hbase4.apache.org,44777,1689837020621' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-20 07:12:06,077 DEBUG [member: 'jenkins-hbase4.apache.org,44777,1689837020621' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,44777,1689837020621 2023-07-20 07:12:06,077 DEBUG [member: 'jenkins-hbase4.apache.org,44777,1689837020621' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-07-20 07:12:06,077 DEBUG [member: 'jenkins-hbase4.apache.org,44777,1689837020621' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,44777,1689837020621' in zk 2023-07-20 07:12:06,077 DEBUG [rs(jenkins-hbase4.apache.org,45099,1689837020733)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1689837124803.cc1a31b2c1bbb19255945e06eefa045b. completed. 2023-07-20 07:12:06,077 DEBUG [rs(jenkins-hbase4.apache.org,45099,1689837020733)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,1,1689837124803.cc1a31b2c1bbb19255945e06eefa045b. 2023-07-20 07:12:06,077 DEBUG [member: 'jenkins-hbase4.apache.org,45099,1689837020733' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-20 07:12:06,077 DEBUG [member: 'jenkins-hbase4.apache.org,45099,1689837020733' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-20 07:12:06,077 DEBUG [member: 'jenkins-hbase4.apache.org,45099,1689837020733' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,45099,1689837020733 2023-07-20 07:12:06,078 DEBUG [member: 'jenkins-hbase4.apache.org,45099,1689837020733' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-07-20 07:12:06,078 DEBUG [member: 'jenkins-hbase4.apache.org,45099,1689837020733' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,45099,1689837020733' in zk 2023-07-20 07:12:06,080 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): master:37415-0x10181911f0f0000, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,44777,1689837020621 2023-07-20 07:12:06,080 DEBUG [member: 'jenkins-hbase4.apache.org,44777,1689837020621' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-20 07:12:06,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,44777,1689837020621 2023-07-20 07:12:06,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-20 07:12:06,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-20 07:12:06,080 DEBUG [member: 'jenkins-hbase4.apache.org,44777,1689837020621' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-20 07:12:06,080 DEBUG [member: 'jenkins-hbase4.apache.org,44777,1689837020621' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-07-20 07:12:06,081 DEBUG [member: 'jenkins-hbase4.apache.org,45099,1689837020733' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-20 07:12:06,081 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): master:37415-0x10181911f0f0000, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45099,1689837020733 2023-07-20 07:12:06,081 DEBUG [member: 'jenkins-hbase4.apache.org,45099,1689837020733' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-20 07:12:06,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-20 07:12:06,081 DEBUG [member: 'jenkins-hbase4.apache.org,45099,1689837020733' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-07-20 07:12:06,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-20 07:12:06,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 07:12:06,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44955,1689837020792 2023-07-20 07:12:06,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44777,1689837020621 2023-07-20 07:12:06,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45099,1689837020733 2023-07-20 07:12:06,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-20 07:12:06,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 07:12:06,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44955,1689837020792 2023-07-20 07:12:06,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44777,1689837020621 2023-07-20 07:12:06,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45099,1689837020733 2023-07-20 07:12:06,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,44777,1689837020621': 2023-07-20 07:12:06,086 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44777,1689837020621' released barrier for procedure'emptySnaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 1 more 2023-07-20 07:12:06,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45099,1689837020733 2023-07-20 07:12:06,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-20 07:12:06,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-20 07:12:06,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-20 07:12:06,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-20 07:12:06,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 07:12:06,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44955,1689837020792 2023-07-20 07:12:06,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44777,1689837020621 2023-07-20 07:12:06,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45099,1689837020733 2023-07-20 07:12:06,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-20 07:12:06,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 07:12:06,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44955,1689837020792 2023-07-20 07:12:06,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44777,1689837020621 2023-07-20 07:12:06,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45099,1689837020733 2023-07-20 07:12:06,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,45099,1689837020733': 2023-07-20 07:12:06,089 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,45099,1689837020733' released barrier for procedure'emptySnaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 0 more 2023-07-20 07:12:06,089 INFO [(jenkins-hbase4.apache.org,37415,1689837019114)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' execution completed 2023-07-20 07:12:06,089 DEBUG [(jenkins-hbase4.apache.org,37415,1689837019114)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-20 07:12:06,089 DEBUG [(jenkins-hbase4.apache.org,37415,1689837019114)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-20 07:12:06,089 DEBUG [(jenkins-hbase4.apache.org,37415,1689837019114)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 07:12:06,089 INFO [(jenkins-hbase4.apache.org,37415,1689837019114)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testEmptyExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-20 07:12:06,091 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): regionserver:45099-0x10181911f0f0002, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 07:12:06,091 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): regionserver:44955-0x10181911f0f0003, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 07:12:06,091 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 07:12:06,091 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): regionserver:45099-0x10181911f0f0002, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 07:12:06,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 07:12:06,091 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): regionserver:44777-0x10181911f0f0001, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 07:12:06,091 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 07:12:06,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 07:12:06,091 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): regionserver:44955-0x10181911f0f0003, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 07:12:06,091 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 07:12:06,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 07:12:06,091 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): regionserver:44777-0x10181911f0f0001, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 07:12:06,092 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 07:12:06,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 07:12:06,092 DEBUG [(jenkins-hbase4.apache.org,37415,1689837019114)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37415-0x10181911f0f0000, quorum=127.0.0.1:58010, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,44955,1689837020792 2023-07-20 07:12:06,092 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 07:12:06,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 07:12:06,092 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 07:12:06,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 07:12:06,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 07:12:06,092 DEBUG [(jenkins-hbase4.apache.org,37415,1689837019114)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37415-0x10181911f0f0000, quorum=127.0.0.1:58010, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,44777,1689837020621 2023-07-20 07:12:06,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 07:12:06,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 07:12:06,093 DEBUG [(jenkins-hbase4.apache.org,37415,1689837019114)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37415-0x10181911f0f0000, quorum=127.0.0.1:58010, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45099,1689837020733 2023-07-20 07:12:06,093 DEBUG [Listener at jenkins-hbase4.apache.org/33837] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-20 07:12:06,094 DEBUG [(jenkins-hbase4.apache.org,37415,1689837019114)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37415-0x10181911f0f0000, quorum=127.0.0.1:58010, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,44955,1689837020792 2023-07-20 07:12:06,094 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-20 07:12:06,094 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): master:37415-0x10181911f0f0000, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 07:12:06,094 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-20 07:12:06,095 DEBUG [(jenkins-hbase4.apache.org,37415,1689837019114)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37415-0x10181911f0f0000, quorum=127.0.0.1:58010, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,44777,1689837020621 2023-07-20 07:12:06,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 07:12:06,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-20 07:12:06,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-20 07:12:06,095 DEBUG [Listener at jenkins-hbase4.apache.org/33837] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-20 07:12:06,095 DEBUG [(jenkins-hbase4.apache.org,37415,1689837019114)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37415-0x10181911f0f0000, quorum=127.0.0.1:58010, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45099,1689837020733 2023-07-20 07:12:06,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-20 07:12:06,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 07:12:06,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-20 07:12:06,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 07:12:06,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44955,1689837020792 2023-07-20 07:12:06,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44777,1689837020621 2023-07-20 07:12:06,098 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): master:37415-0x10181911f0f0000, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45099,1689837020733 2023-07-20 07:12:06,098 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): regionserver:45099-0x10181911f0f0002, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 07:12:06,098 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): regionserver:44777-0x10181911f0f0001, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 07:12:06,098 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): regionserver:44955-0x10181911f0f0003, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 07:12:06,098 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 07:12:06,098 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): master:37415-0x10181911f0f0000, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 07:12:06,098 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 07:12:06,098 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): master:37415-0x10181911f0f0000, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,44777,1689837020621 2023-07-20 07:12:06,098 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): master:37415-0x10181911f0f0000, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,44955,1689837020792 2023-07-20 07:12:06,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 07:12:06,098 DEBUG [(jenkins-hbase4.apache.org,37415,1689837019114)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-20 07:12:06,098 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): regionserver:45099-0x10181911f0f0002, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 07:12:06,098 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 07:12:06,100 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): regionserver:44777-0x10181911f0f0001, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 07:12:06,098 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): regionserver:44955-0x10181911f0f0003, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 07:12:06,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 07:12:06,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45099,1689837020733 2023-07-20 07:12:06,098 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 07:12:06,098 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): master:37415-0x10181911f0f0000, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 07:12:06,100 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testEmptyExportFileSystemState 2023-07-20 07:12:06,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 07:12:06,100 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 37e3865d2ff7e5e2da33a03e3f723df0, NAME => 'testtb-testEmptyExportFileSystemState,.mob,0.37e3865d2ff7e5e2da33a03e3f723df0.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 07:12:06,100 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): master:37415-0x10181911f0f0000, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45099,1689837020733 2023-07-20 07:12:06,100 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-20 07:12:06,100 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): master:37415-0x10181911f0f0000, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 07:12:06,100 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): master:37415-0x10181911f0f0000, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,44777,1689837020621 2023-07-20 07:12:06,100 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): master:37415-0x10181911f0f0000, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,44955,1689837020792 2023-07-20 07:12:06,100 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): master:37415-0x10181911f0f0000, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 07:12:06,101 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): master:37415-0x10181911f0f0000, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 07:12:06,101 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 07:12:06,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 07:12:06,101 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-07-20 07:12:06,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-20 07:12:06,101 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 07:12:06,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 07:12:06,101 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 07:12:06,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 07:12:06,102 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:37415-0x10181911f0f0000, quorum=127.0.0.1:58010, baseZNode=/hbase Unable to get data of znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState because node does not exist (not an error) 2023-07-20 07:12:06,108 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 07:12:06,109 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 07:12:06,137 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState to hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 07:12:06,161 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed 2023-07-20 07:12:06,162 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 07:12:06,162 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 07:12:06,162 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState at 1689837125992Completed referencing HFiles for the mob region of table: testtb-testEmptyExportFileSystemState at 1689837126108 (+116 ms)Consolidate snapshot: emptySnaptb0-testEmptyExportFileSystemState at 1689837126108Loading Region manifests for emptySnaptb0-testEmptyExportFileSystemState at 1689837126108Writing data manifest for emptySnaptb0-testEmptyExportFileSystemState at 1689837126113 (+5 ms)Verifying snapshot: emptySnaptb0-testEmptyExportFileSystemState at 1689837126128 (+15 ms)Snapshot emptySnaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed at 1689837126161 (+33 ms) 2023-07-20 07:12:06,166 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=96, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-20 07:12:06,167 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=96, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED in 173 msec 2023-07-20 07:12:06,295 DEBUG [Listener at jenkins-hbase4.apache.org/33837] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-20 07:12:06,296 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-20 07:12:06,296 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-20 07:12:06,300 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45099] regionserver.HRegion(8805): writing data to region testtb-testEmptyExportFileSystemState,1,1689837124803.cc1a31b2c1bbb19255945e06eefa045b. with WAL disabled. Data may be lost in the event of a crash. 2023-07-20 07:12:06,311 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44777] regionserver.HRegion(8805): writing data to region testtb-testEmptyExportFileSystemState,,1689837124803.92a00c925bbc0b2fd5b0b5900d64b365. with WAL disabled. Data may be lost in the event of a crash. 2023-07-20 07:12:06,314 DEBUG [Listener at jenkins-hbase4.apache.org/33837] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testEmptyExportFileSystemState 2023-07-20 07:12:06,314 DEBUG [Listener at jenkins-hbase4.apache.org/33837] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testEmptyExportFileSystemState,,1689837124803.92a00c925bbc0b2fd5b0b5900d64b365. 2023-07-20 07:12:06,314 INFO [Listener at jenkins-hbase4.apache.org/33837] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-20 07:12:06,325 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-20 07:12:06,325 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689837126325 (current time:1689837126325). 2023-07-20 07:12:06,325 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-20 07:12:06,325 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] zookeeper.ReadOnlyZKClient(139): Connect 0x40b74fd8 to 127.0.0.1:58010 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-20 07:12:06,337 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6668f8b3, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-20 07:12:06,339 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-20 07:12:06,344 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:55716, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-20 07:12:06,345 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x40b74fd8 to 127.0.0.1:58010 2023-07-20 07:12:06,345 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-20 07:12:06,345 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] zookeeper.ReadOnlyZKClient(139): Connect 0x2972e903 to 127.0.0.1:58010 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-20 07:12:06,360 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@53c1aa7a, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-20 07:12:06,362 DEBUG [hconnection-0x724d6dd1-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-20 07:12:06,363 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:55720, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-20 07:12:06,368 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-20 07:12:06,370 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:46742, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-20 07:12:06,371 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2972e903 to 127.0.0.1:58010 2023-07-20 07:12:06,371 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-20 07:12:06,372 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-07-20 07:12:06,375 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-20 07:12:06,376 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-20 07:12:06,381 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] procedure2.ProcedureExecutor(1029): Stored pid=97, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-20 07:12:06,388 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=97, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-20 07:12:06,389 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=97, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1689837726389 2023-07-20 07:12:06,389 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-20 07:12:06,389 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState 2023-07-20 07:12:06,392 DEBUG [Listener at jenkins-hbase4.apache.org/33837] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-20 07:12:06,392 DEBUG [Listener at jenkins-hbase4.apache.org/33837] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-20 07:12:06,395 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=98, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-20 07:12:06,400 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=97, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-20 07:12:06,401 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=97, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE in 21 msec 2023-07-20 07:12:06,403 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=98, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-20 07:12:06,403 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=98, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED; timeout=600000, timestamp=1689837726403 2023-07-20 07:12:06,430 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testEmptyExportFileSystemState 2023-07-20 07:12:06,430 INFO [(jenkins-hbase4.apache.org,37415,1689837019114)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testEmptyExportFileSystemState' 2023-07-20 07:12:06,430 DEBUG [(jenkins-hbase4.apache.org,37415,1689837019114)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-20 07:12:06,432 DEBUG [(jenkins-hbase4.apache.org,37415,1689837019114)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' 2023-07-20 07:12:06,433 DEBUG [(jenkins-hbase4.apache.org,37415,1689837019114)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testEmptyExportFileSystemState', kicking off acquire phase on members. 2023-07-20 07:12:06,433 DEBUG [(jenkins-hbase4.apache.org,37415,1689837019114)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37415-0x10181911f0f0000, quorum=127.0.0.1:58010, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-20 07:12:06,433 DEBUG [(jenkins-hbase4.apache.org,37415,1689837019114)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-20 07:12:06,435 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): regionserver:44955-0x10181911f0f0003, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 07:12:06,435 DEBUG [(jenkins-hbase4.apache.org,37415,1689837019114)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,44777,1689837020621 2023-07-20 07:12:06,435 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): regionserver:44777-0x10181911f0f0001, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 07:12:06,435 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): regionserver:45099-0x10181911f0f0002, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 07:12:06,436 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 07:12:06,435 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 07:12:06,436 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 07:12:06,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 07:12:06,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 07:12:06,436 DEBUG [(jenkins-hbase4.apache.org,37415,1689837019114)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37415-0x10181911f0f0000, quorum=127.0.0.1:58010, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,44777,1689837020621 2023-07-20 07:12:06,436 DEBUG [(jenkins-hbase4.apache.org,37415,1689837019114)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45099,1689837020733 2023-07-20 07:12:06,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 07:12:06,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-20 07:12:06,437 DEBUG [(jenkins-hbase4.apache.org,37415,1689837019114)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37415-0x10181911f0f0000, quorum=127.0.0.1:58010, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45099,1689837020733 2023-07-20 07:12:06,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-20 07:12:06,437 DEBUG [(jenkins-hbase4.apache.org,37415,1689837019114)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-20 07:12:06,437 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45099-0x10181911f0f0002, quorum=127.0.0.1:58010, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-20 07:12:06,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-20 07:12:06,437 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44955-0x10181911f0f0003, quorum=127.0.0.1:58010, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-20 07:12:06,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-07-20 07:12:06,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-20 07:12:06,437 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44777-0x10181911f0f0001, quorum=127.0.0.1:58010, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-20 07:12:06,437 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-20 07:12:06,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-07-20 07:12:06,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-20 07:12:06,438 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-20 07:12:06,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-07-20 07:12:06,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-20 07:12:06,438 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-07-20 07:12:06,438 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-07-20 07:12:06,438 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-20 07:12:06,438 DEBUG [member: 'jenkins-hbase4.apache.org,44955,1689837020792' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-20 07:12:06,438 DEBUG [member: 'jenkins-hbase4.apache.org,44955,1689837020792' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-20 07:12:06,438 DEBUG [member: 'jenkins-hbase4.apache.org,45099,1689837020733' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-20 07:12:06,442 DEBUG [member: 'jenkins-hbase4.apache.org,45099,1689837020733' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-20 07:12:06,440 DEBUG [member: 'jenkins-hbase4.apache.org,44955,1689837020792' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-20 07:12:06,443 DEBUG [member: 'jenkins-hbase4.apache.org,44955,1689837020792' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-20 07:12:06,443 DEBUG [member: 'jenkins-hbase4.apache.org,44955,1689837020792' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44955,1689837020792' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-07-20 07:12:06,443 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-07-20 07:12:06,443 DEBUG [member: 'jenkins-hbase4.apache.org,44777,1689837020621' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-20 07:12:06,443 DEBUG [member: 'jenkins-hbase4.apache.org,44777,1689837020621' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-20 07:12:06,450 DEBUG [member: 'jenkins-hbase4.apache.org,45099,1689837020733' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-20 07:12:06,450 DEBUG [member: 'jenkins-hbase4.apache.org,45099,1689837020733' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-20 07:12:06,450 DEBUG [member: 'jenkins-hbase4.apache.org,44777,1689837020621' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-20 07:12:06,450 DEBUG [member: 'jenkins-hbase4.apache.org,44777,1689837020621' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-20 07:12:06,450 DEBUG [member: 'jenkins-hbase4.apache.org,44777,1689837020621' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44777,1689837020621' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-07-20 07:12:06,450 DEBUG [member: 'jenkins-hbase4.apache.org,45099,1689837020733' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45099,1689837020733' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-07-20 07:12:06,452 DEBUG [member: 'jenkins-hbase4.apache.org,44955,1689837020792' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-20 07:12:06,453 DEBUG [member: 'jenkins-hbase4.apache.org,45099,1689837020733' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-20 07:12:06,453 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): master:37415-0x10181911f0f0000, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45099,1689837020733 2023-07-20 07:12:06,453 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45099,1689837020733 2023-07-20 07:12:06,453 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-20 07:12:06,453 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-20 07:12:06,455 DEBUG [member: 'jenkins-hbase4.apache.org,44777,1689837020621' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-20 07:12:06,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-20 07:12:06,455 DEBUG [member: 'jenkins-hbase4.apache.org,44955,1689837020792' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44955-0x10181911f0f0003, quorum=127.0.0.1:58010, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-20 07:12:06,455 DEBUG [member: 'jenkins-hbase4.apache.org,45099,1689837020733' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45099-0x10181911f0f0002, quorum=127.0.0.1:58010, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-20 07:12:06,456 DEBUG [member: 'jenkins-hbase4.apache.org,45099,1689837020733' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-20 07:12:06,455 DEBUG [member: 'jenkins-hbase4.apache.org,44955,1689837020792' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-20 07:12:06,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-20 07:12:06,456 DEBUG [member: 'jenkins-hbase4.apache.org,44777,1689837020621' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44777-0x10181911f0f0001, quorum=127.0.0.1:58010, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-20 07:12:06,456 DEBUG [member: 'jenkins-hbase4.apache.org,44777,1689837020621' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-20 07:12:06,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-20 07:12:06,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44955,1689837020792 2023-07-20 07:12:06,457 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44777,1689837020621 2023-07-20 07:12:06,457 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45099,1689837020733 2023-07-20 07:12:06,458 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-20 07:12:06,458 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,45099,1689837020733' joining acquired barrier for procedure 'snaptb0-testEmptyExportFileSystemState' on coordinator 2023-07-20 07:12:06,458 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3f6d31aa[Count = 1] remaining members to acquire global barrier 2023-07-20 07:12:06,458 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): master:37415-0x10181911f0f0000, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,44777,1689837020621 2023-07-20 07:12:06,458 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,44777,1689837020621 2023-07-20 07:12:06,459 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-20 07:12:06,459 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-20 07:12:06,459 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-20 07:12:06,460 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-20 07:12:06,460 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-20 07:12:06,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44955,1689837020792 2023-07-20 07:12:06,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44777,1689837020621 2023-07-20 07:12:06,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45099,1689837020733 2023-07-20 07:12:06,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-20 07:12:06,462 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44777,1689837020621' joining acquired barrier for procedure 'snaptb0-testEmptyExportFileSystemState' on coordinator 2023-07-20 07:12:06,462 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3f6d31aa[Count = 0] remaining members to acquire global barrier 2023-07-20 07:12:06,462 DEBUG [(jenkins-hbase4.apache.org,37415,1689837019114)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testEmptyExportFileSystemState' starting 'in-barrier' execution. 2023-07-20 07:12:06,462 DEBUG [(jenkins-hbase4.apache.org,37415,1689837019114)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-20 07:12:06,467 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): regionserver:45099-0x10181911f0f0002, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-20 07:12:06,467 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): regionserver:44955-0x10181911f0f0003, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-20 07:12:06,467 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): regionserver:44777-0x10181911f0f0001, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-20 07:12:06,467 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-20 07:12:06,467 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-20 07:12:06,467 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-20 07:12:06,467 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-20 07:12:06,467 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-20 07:12:06,467 DEBUG [member: 'jenkins-hbase4.apache.org,44777,1689837020621' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-20 07:12:06,467 DEBUG [member: 'jenkins-hbase4.apache.org,45099,1689837020733' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-20 07:12:06,467 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-20 07:12:06,467 DEBUG [(jenkins-hbase4.apache.org,37415,1689837019114)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37415-0x10181911f0f0000, quorum=127.0.0.1:58010, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45099,1689837020733 2023-07-20 07:12:06,467 DEBUG [member: 'jenkins-hbase4.apache.org,44955,1689837020792' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-20 07:12:06,467 DEBUG [member: 'jenkins-hbase4.apache.org,44777,1689837020621' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-20 07:12:06,467 DEBUG [member: 'jenkins-hbase4.apache.org,44777,1689837020621' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-20 07:12:06,467 DEBUG [member: 'jenkins-hbase4.apache.org,44955,1689837020792' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-07-20 07:12:06,468 DEBUG [member: 'jenkins-hbase4.apache.org,44955,1689837020792' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,44955,1689837020792' in zk 2023-07-20 07:12:06,468 DEBUG [rs(jenkins-hbase4.apache.org,44777,1689837020621)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,,1689837124803.92a00c925bbc0b2fd5b0b5900d64b365. 2023-07-20 07:12:06,468 DEBUG [(jenkins-hbase4.apache.org,37415,1689837019114)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37415-0x10181911f0f0000, quorum=127.0.0.1:58010, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,44777,1689837020621 2023-07-20 07:12:06,468 DEBUG [(jenkins-hbase4.apache.org,37415,1689837019114)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-20 07:12:06,468 DEBUG [rs(jenkins-hbase4.apache.org,44777,1689837020621)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1689837124803.92a00c925bbc0b2fd5b0b5900d64b365. started... 2023-07-20 07:12:06,468 INFO [rs(jenkins-hbase4.apache.org,44777,1689837020621)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 92a00c925bbc0b2fd5b0b5900d64b365 1/1 column families, dataSize=333 B heapSize=976 B 2023-07-20 07:12:06,470 DEBUG [member: 'jenkins-hbase4.apache.org,45099,1689837020733' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-20 07:12:06,471 DEBUG [member: 'jenkins-hbase4.apache.org,45099,1689837020733' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-20 07:12:06,471 DEBUG [rs(jenkins-hbase4.apache.org,45099,1689837020733)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,1,1689837124803.cc1a31b2c1bbb19255945e06eefa045b. 2023-07-20 07:12:06,471 DEBUG [member: 'jenkins-hbase4.apache.org,44955,1689837020792' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-20 07:12:06,471 DEBUG [rs(jenkins-hbase4.apache.org,45099,1689837020733)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1689837124803.cc1a31b2c1bbb19255945e06eefa045b. started... 2023-07-20 07:12:06,471 DEBUG [member: 'jenkins-hbase4.apache.org,44955,1689837020792' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-20 07:12:06,471 DEBUG [member: 'jenkins-hbase4.apache.org,44955,1689837020792' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-07-20 07:12:06,473 INFO [rs(jenkins-hbase4.apache.org,45099,1689837020733)-snapshot-pool-0] regionserver.HRegion(2745): Flushing cc1a31b2c1bbb19255945e06eefa045b 1/1 column families, dataSize=2.93 KB heapSize=6.58 KB 2023-07-20 07:12:06,492 DEBUG [Listener at jenkins-hbase4.apache.org/33837] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-20 07:12:06,494 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-20 07:12:06,494 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-20 07:12:06,494 DEBUG [Listener at jenkins-hbase4.apache.org/33837] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-20 07:12:06,542 INFO [rs(jenkins-hbase4.apache.org,44777,1689837020621)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230720c8a970c7cb264ee8911c597bfb8b7c2b to hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e20230720c8a970c7cb264ee8911c597bfb8b7c2b 2023-07-20 07:12:06,694 DEBUG [Listener at jenkins-hbase4.apache.org/33837] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-20 07:12:06,696 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-20 07:12:06,696 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-20 07:12:06,696 DEBUG [Listener at jenkins-hbase4.apache.org/33837] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-20 07:12:06,944 INFO [rs(jenkins-hbase4.apache.org,45099,1689837020733)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230720cd120be9ff5e4106b8da8b7141ca9a18 to hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b20230720cd120be9ff5e4106b8da8b7141ca9a18 2023-07-20 07:12:06,964 INFO [rs(jenkins-hbase4.apache.org,45099,1689837020733)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=2.9 K, hasBloomFilter=true, into tmp file hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/data/default/testtb-testEmptyExportFileSystemState/cc1a31b2c1bbb19255945e06eefa045b/.tmp/cf/6d5a76f522c248a49123caa980a113c4 2023-07-20 07:12:06,966 INFO [rs(jenkins-hbase4.apache.org,44777,1689837020621)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=333, hasBloomFilter=true, into tmp file hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/data/default/testtb-testEmptyExportFileSystemState/92a00c925bbc0b2fd5b0b5900d64b365/.tmp/cf/755219923bd0415ba10eb05e95a792df 2023-07-20 07:12:06,974 DEBUG [rs(jenkins-hbase4.apache.org,44777,1689837020621)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/data/default/testtb-testEmptyExportFileSystemState/92a00c925bbc0b2fd5b0b5900d64b365/.tmp/cf/755219923bd0415ba10eb05e95a792df as hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/data/default/testtb-testEmptyExportFileSystemState/92a00c925bbc0b2fd5b0b5900d64b365/cf/755219923bd0415ba10eb05e95a792df 2023-07-20 07:12:06,974 DEBUG [rs(jenkins-hbase4.apache.org,45099,1689837020733)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/data/default/testtb-testEmptyExportFileSystemState/cc1a31b2c1bbb19255945e06eefa045b/.tmp/cf/6d5a76f522c248a49123caa980a113c4 as hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/data/default/testtb-testEmptyExportFileSystemState/cc1a31b2c1bbb19255945e06eefa045b/cf/6d5a76f522c248a49123caa980a113c4 2023-07-20 07:12:06,981 INFO [rs(jenkins-hbase4.apache.org,44777,1689837020621)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/data/default/testtb-testEmptyExportFileSystemState/92a00c925bbc0b2fd5b0b5900d64b365/cf/755219923bd0415ba10eb05e95a792df, entries=5, sequenceid=6, filesize=5.8 K 2023-07-20 07:12:06,981 INFO [rs(jenkins-hbase4.apache.org,45099,1689837020733)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/data/default/testtb-testEmptyExportFileSystemState/cc1a31b2c1bbb19255945e06eefa045b/cf/6d5a76f522c248a49123caa980a113c4, entries=45, sequenceid=6, filesize=12.7 K 2023-07-20 07:12:06,982 INFO [rs(jenkins-hbase4.apache.org,45099,1689837020733)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~2.93 KB/3003, heapSize ~6.56 KB/6720, currentSize=0 B/0 for cc1a31b2c1bbb19255945e06eefa045b in 511ms, sequenceid=6, compaction requested=false 2023-07-20 07:12:06,982 DEBUG [rs(jenkins-hbase4.apache.org,45099,1689837020733)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testEmptyExportFileSystemState' 2023-07-20 07:12:06,983 DEBUG [rs(jenkins-hbase4.apache.org,45099,1689837020733)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for cc1a31b2c1bbb19255945e06eefa045b: 2023-07-20 07:12:06,983 DEBUG [rs(jenkins-hbase4.apache.org,45099,1689837020733)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,1,1689837124803.cc1a31b2c1bbb19255945e06eefa045b.' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-20 07:12:06,984 DEBUG [rs(jenkins-hbase4.apache.org,45099,1689837020733)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-20 07:12:06,984 DEBUG [rs(jenkins-hbase4.apache.org,45099,1689837020733)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/data/default/testtb-testEmptyExportFileSystemState/cc1a31b2c1bbb19255945e06eefa045b/cf/6d5a76f522c248a49123caa980a113c4] hfiles 2023-07-20 07:12:06,984 DEBUG [rs(jenkins-hbase4.apache.org,45099,1689837020733)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/data/default/testtb-testEmptyExportFileSystemState/cc1a31b2c1bbb19255945e06eefa045b/cf/6d5a76f522c248a49123caa980a113c4 for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-20 07:12:06,985 INFO [rs(jenkins-hbase4.apache.org,44777,1689837020621)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~333 B/333, heapSize ~960 B/960, currentSize=0 B/0 for 92a00c925bbc0b2fd5b0b5900d64b365 in 517ms, sequenceid=6, compaction requested=false 2023-07-20 07:12:06,988 DEBUG [rs(jenkins-hbase4.apache.org,44777,1689837020621)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 92a00c925bbc0b2fd5b0b5900d64b365: 2023-07-20 07:12:06,988 DEBUG [rs(jenkins-hbase4.apache.org,44777,1689837020621)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,,1689837124803.92a00c925bbc0b2fd5b0b5900d64b365.' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-20 07:12:06,990 DEBUG [rs(jenkins-hbase4.apache.org,44777,1689837020621)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-20 07:12:06,990 DEBUG [rs(jenkins-hbase4.apache.org,44777,1689837020621)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/data/default/testtb-testEmptyExportFileSystemState/92a00c925bbc0b2fd5b0b5900d64b365/cf/755219923bd0415ba10eb05e95a792df] hfiles 2023-07-20 07:12:06,990 DEBUG [rs(jenkins-hbase4.apache.org,44777,1689837020621)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/data/default/testtb-testEmptyExportFileSystemState/92a00c925bbc0b2fd5b0b5900d64b365/cf/755219923bd0415ba10eb05e95a792df for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-20 07:12:06,996 DEBUG [Listener at jenkins-hbase4.apache.org/33837] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-20 07:12:06,997 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-20 07:12:06,997 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-20 07:12:06,998 DEBUG [Listener at jenkins-hbase4.apache.org/33837] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-07-20 07:12:07,016 DEBUG [rs(jenkins-hbase4.apache.org,45099,1689837020733)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1689837124803.cc1a31b2c1bbb19255945e06eefa045b. completed. 2023-07-20 07:12:07,016 DEBUG [rs(jenkins-hbase4.apache.org,45099,1689837020733)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,1,1689837124803.cc1a31b2c1bbb19255945e06eefa045b. 2023-07-20 07:12:07,016 DEBUG [member: 'jenkins-hbase4.apache.org,45099,1689837020733' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-20 07:12:07,016 DEBUG [member: 'jenkins-hbase4.apache.org,45099,1689837020733' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-20 07:12:07,016 DEBUG [member: 'jenkins-hbase4.apache.org,45099,1689837020733' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,45099,1689837020733 2023-07-20 07:12:07,016 DEBUG [member: 'jenkins-hbase4.apache.org,45099,1689837020733' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-07-20 07:12:07,016 DEBUG [member: 'jenkins-hbase4.apache.org,45099,1689837020733' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,45099,1689837020733' in zk 2023-07-20 07:12:07,018 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): master:37415-0x10181911f0f0000, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45099,1689837020733 2023-07-20 07:12:07,018 DEBUG [member: 'jenkins-hbase4.apache.org,45099,1689837020733' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-20 07:12:07,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45099,1689837020733 2023-07-20 07:12:07,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-20 07:12:07,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-20 07:12:07,018 DEBUG [member: 'jenkins-hbase4.apache.org,45099,1689837020733' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-20 07:12:07,018 DEBUG [member: 'jenkins-hbase4.apache.org,45099,1689837020733' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-07-20 07:12:07,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-20 07:12:07,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-20 07:12:07,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-20 07:12:07,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44955,1689837020792 2023-07-20 07:12:07,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44777,1689837020621 2023-07-20 07:12:07,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45099,1689837020733 2023-07-20 07:12:07,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-20 07:12:07,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-20 07:12:07,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44955,1689837020792 2023-07-20 07:12:07,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45099,1689837020733 2023-07-20 07:12:07,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,45099,1689837020733': 2023-07-20 07:12:07,037 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,45099,1689837020733' released barrier for procedure'snaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 1 more 2023-07-20 07:12:07,443 DEBUG [rs(jenkins-hbase4.apache.org,44777,1689837020621)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1689837124803.92a00c925bbc0b2fd5b0b5900d64b365. completed. 2023-07-20 07:12:07,443 DEBUG [rs(jenkins-hbase4.apache.org,44777,1689837020621)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,,1689837124803.92a00c925bbc0b2fd5b0b5900d64b365. 2023-07-20 07:12:07,443 DEBUG [member: 'jenkins-hbase4.apache.org,44777,1689837020621' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-20 07:12:07,443 DEBUG [member: 'jenkins-hbase4.apache.org,44777,1689837020621' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-20 07:12:07,443 DEBUG [member: 'jenkins-hbase4.apache.org,44777,1689837020621' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,44777,1689837020621 2023-07-20 07:12:07,443 DEBUG [member: 'jenkins-hbase4.apache.org,44777,1689837020621' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-07-20 07:12:07,443 DEBUG [member: 'jenkins-hbase4.apache.org,44777,1689837020621' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,44777,1689837020621' in zk 2023-07-20 07:12:07,445 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): master:37415-0x10181911f0f0000, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,44777,1689837020621 2023-07-20 07:12:07,445 DEBUG [member: 'jenkins-hbase4.apache.org,44777,1689837020621' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-20 07:12:07,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,44777,1689837020621 2023-07-20 07:12:07,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-20 07:12:07,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-20 07:12:07,445 DEBUG [member: 'jenkins-hbase4.apache.org,44777,1689837020621' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-20 07:12:07,445 DEBUG [member: 'jenkins-hbase4.apache.org,44777,1689837020621' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-07-20 07:12:07,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-20 07:12:07,448 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-20 07:12:07,448 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-20 07:12:07,448 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44955,1689837020792 2023-07-20 07:12:07,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44777,1689837020621 2023-07-20 07:12:07,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45099,1689837020733 2023-07-20 07:12:07,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-20 07:12:07,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-20 07:12:07,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44955,1689837020792 2023-07-20 07:12:07,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44777,1689837020621 2023-07-20 07:12:07,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45099,1689837020733 2023-07-20 07:12:07,452 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,44777,1689837020621': 2023-07-20 07:12:07,452 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44777,1689837020621' released barrier for procedure'snaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 0 more 2023-07-20 07:12:07,452 INFO [(jenkins-hbase4.apache.org,37415,1689837019114)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testEmptyExportFileSystemState' execution completed 2023-07-20 07:12:07,452 DEBUG [(jenkins-hbase4.apache.org,37415,1689837019114)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-20 07:12:07,452 DEBUG [(jenkins-hbase4.apache.org,37415,1689837019114)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-20 07:12:07,452 DEBUG [(jenkins-hbase4.apache.org,37415,1689837019114)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testEmptyExportFileSystemState 2023-07-20 07:12:07,452 INFO [(jenkins-hbase4.apache.org,37415,1689837019114)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testEmptyExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-20 07:12:07,454 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): master:37415-0x10181911f0f0000, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-20 07:12:07,454 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): regionserver:45099-0x10181911f0f0002, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-20 07:12:07,454 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-20 07:12:07,454 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-20 07:12:07,454 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-20 07:12:07,454 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-20 07:12:07,454 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): regionserver:45099-0x10181911f0f0002, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 07:12:07,454 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): regionserver:44777-0x10181911f0f0001, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-20 07:12:07,454 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): regionserver:44955-0x10181911f0f0003, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-20 07:12:07,454 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-20 07:12:07,454 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): regionserver:44777-0x10181911f0f0001, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 07:12:07,454 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-20 07:12:07,454 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-20 07:12:07,454 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-20 07:12:07,454 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-20 07:12:07,454 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): regionserver:44955-0x10181911f0f0003, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 07:12:07,455 DEBUG [(jenkins-hbase4.apache.org,37415,1689837019114)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37415-0x10181911f0f0000, quorum=127.0.0.1:58010, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,44955,1689837020792 2023-07-20 07:12:07,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-20 07:12:07,455 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 07:12:07,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 07:12:07,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-20 07:12:07,455 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 07:12:07,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-20 07:12:07,455 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 07:12:07,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 07:12:07,455 DEBUG [(jenkins-hbase4.apache.org,37415,1689837019114)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37415-0x10181911f0f0000, quorum=127.0.0.1:58010, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,44777,1689837020621 2023-07-20 07:12:07,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 07:12:07,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-20 07:12:07,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-20 07:12:07,456 DEBUG [(jenkins-hbase4.apache.org,37415,1689837019114)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37415-0x10181911f0f0000, quorum=127.0.0.1:58010, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45099,1689837020733 2023-07-20 07:12:07,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-20 07:12:07,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-20 07:12:07,457 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44955,1689837020792 2023-07-20 07:12:07,457 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44777,1689837020621 2023-07-20 07:12:07,457 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45099,1689837020733 2023-07-20 07:12:07,458 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-20 07:12:07,458 DEBUG [(jenkins-hbase4.apache.org,37415,1689837019114)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37415-0x10181911f0f0000, quorum=127.0.0.1:58010, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,44955,1689837020792 2023-07-20 07:12:07,458 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-20 07:12:07,458 DEBUG [(jenkins-hbase4.apache.org,37415,1689837019114)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37415-0x10181911f0f0000, quorum=127.0.0.1:58010, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,44777,1689837020621 2023-07-20 07:12:07,458 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44955,1689837020792 2023-07-20 07:12:07,459 DEBUG [(jenkins-hbase4.apache.org,37415,1689837019114)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37415-0x10181911f0f0000, quorum=127.0.0.1:58010, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45099,1689837020733 2023-07-20 07:12:07,459 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44777,1689837020621 2023-07-20 07:12:07,460 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45099,1689837020733 2023-07-20 07:12:07,466 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): regionserver:44955-0x10181911f0f0003, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 07:12:07,466 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): master:37415-0x10181911f0f0000, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45099,1689837020733 2023-07-20 07:12:07,466 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 07:12:07,466 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): master:37415-0x10181911f0f0000, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-20 07:12:07,466 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): regionserver:45099-0x10181911f0f0002, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 07:12:07,466 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): regionserver:45099-0x10181911f0f0002, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 07:12:07,466 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): regionserver:44955-0x10181911f0f0003, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 07:12:07,466 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 07:12:07,466 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testEmptyExportFileSystemState 2023-07-20 07:12:07,466 DEBUG [(jenkins-hbase4.apache.org,37415,1689837019114)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-20 07:12:07,466 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testEmptyExportFileSystemState 2023-07-20 07:12:07,466 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): master:37415-0x10181911f0f0000, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,44777,1689837020621 2023-07-20 07:12:07,466 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 07:12:07,468 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): regionserver:44777-0x10181911f0f0001, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 07:12:07,468 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): master:37415-0x10181911f0f0000, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,44955,1689837020792 2023-07-20 07:12:07,468 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 07:12:07,468 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 07:12:07,468 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 37e3865d2ff7e5e2da33a03e3f723df0, NAME => 'testtb-testEmptyExportFileSystemState,.mob,0.37e3865d2ff7e5e2da33a03e3f723df0.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-20 07:12:07,469 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-20 07:12:07,469 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 07:12:07,469 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 07:12:07,466 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 07:12:07,468 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): master:37415-0x10181911f0f0000, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-20 07:12:07,469 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): master:37415-0x10181911f0f0000, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45099,1689837020733 2023-07-20 07:12:07,469 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): master:37415-0x10181911f0f0000, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-20 07:12:07,469 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): master:37415-0x10181911f0f0000, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,44777,1689837020621 2023-07-20 07:12:07,469 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): master:37415-0x10181911f0f0000, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,44955,1689837020792 2023-07-20 07:12:07,469 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): master:37415-0x10181911f0f0000, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-20 07:12:07,469 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): master:37415-0x10181911f0f0000, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-20 07:12:07,468 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): regionserver:44777-0x10181911f0f0001, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 07:12:07,469 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 07:12:07,469 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 07:12:07,470 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b20230720cd120be9ff5e4106b8da8b7141ca9a18, hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e20230720c8a970c7cb264ee8911c597bfb8b7c2b] mob files 2023-07-20 07:12:07,470 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b20230720cd120be9ff5e4106b8da8b7141ca9a18 2023-07-20 07:12:07,470 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e20230720c8a970c7cb264ee8911c597bfb8b7c2b 2023-07-20 07:12:07,470 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 07:12:07,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 07:12:07,482 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testEmptyExportFileSystemState 2023-07-20 07:12:07,482 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-07-20 07:12:07,498 DEBUG [Listener at jenkins-hbase4.apache.org/33837] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-20 07:12:07,499 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-20 07:12:07,499 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-20 07:12:07,499 DEBUG [Listener at jenkins-hbase4.apache.org/33837] client.HBaseAdmin(2428): (#5) Sleeping: 1000ms while waiting for snapshot completion. 2023-07-20 07:12:07,520 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState to hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/.hbase-snapshot/snaptb0-testEmptyExportFileSystemState 2023-07-20 07:12:07,559 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed 2023-07-20 07:12:07,559 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-07-20 07:12:07,559 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-07-20 07:12:07,559 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState at 1689837126389Completed referencing HFiles for the mob region of table: testtb-testEmptyExportFileSystemState at 1689837127482 (+1093 ms)Consolidate snapshot: snaptb0-testEmptyExportFileSystemState at 1689837127482Loading Region manifests for snaptb0-testEmptyExportFileSystemState at 1689837127482Writing data manifest for snaptb0-testEmptyExportFileSystemState at 1689837127493 (+11 ms)Verifying snapshot: snaptb0-testEmptyExportFileSystemState at 1689837127511 (+18 ms)Snapshot snaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed at 1689837127559 (+48 ms) 2023-07-20 07:12:07,563 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=98, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-20 07:12:07,564 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=98, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED in 1.1720 sec 2023-07-20 07:12:08,500 DEBUG [Listener at jenkins-hbase4.apache.org/33837] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-20 07:12:08,501 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-20 07:12:08,501 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-20 07:12:08,501 INFO [Listener at jenkins-hbase4.apache.org/33837] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/export-test/export-1689837128501 2023-07-20 07:12:08,502 INFO [Listener at jenkins-hbase4.apache.org/33837] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:39649, tgtDir=hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/export-test/export-1689837128501, rawTgtDir=hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/export-test/export-1689837128501, srcFsUri=hdfs://localhost:39649, srcDir=hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b 2023-07-20 07:12:08,533 DEBUG [Listener at jenkins-hbase4.apache.org/33837] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:39649, inputRoot=hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b 2023-07-20 07:12:08,533 DEBUG [Listener at jenkins-hbase4.apache.org/33837] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-727870474_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/export-test/export-1689837128501, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/export-test/export-1689837128501/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 07:12:08,533 INFO [Listener at jenkins-hbase4.apache.org/33837] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:39649, inputRoot=hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b, snapshotDir=hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState. 2023-07-20 07:12:08,547 INFO [Listener at jenkins-hbase4.apache.org/33837] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState to hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/export-test/export-1689837128501/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 07:12:08,646 DEBUG [Listener at jenkins-hbase4.apache.org/33837] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-20 07:12:08,646 DEBUG [Listener at jenkins-hbase4.apache.org/33837] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-20 07:12:08,647 DEBUG [Listener at jenkins-hbase4.apache.org/33837] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-20 07:12:08,648 DEBUG [Listener at jenkins-hbase4.apache.org/33837] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-20 07:12:08,648 DEBUG [Listener at jenkins-hbase4.apache.org/33837] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-20 07:12:08,649 DEBUG [Listener at jenkins-hbase4.apache.org/33837] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-20 07:12:08,649 DEBUG [Listener at jenkins-hbase4.apache.org/33837] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-20 07:12:08,750 DEBUG [Listener at jenkins-hbase4.apache.org/33837] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c07d5e8c-eba2-0ae8-aa3a-b7afa648e7e7/hadoop-4357969909703044643.jar 2023-07-20 07:12:08,751 DEBUG [Listener at jenkins-hbase4.apache.org/33837] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-20 07:12:08,751 DEBUG [Listener at jenkins-hbase4.apache.org/33837] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-20 07:12:08,752 DEBUG [Listener at jenkins-hbase4.apache.org/33837] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-20 07:12:08,752 DEBUG [Listener at jenkins-hbase4.apache.org/33837] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-20 07:12:08,753 DEBUG [Listener at jenkins-hbase4.apache.org/33837] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-20 07:12:08,753 DEBUG [Listener at jenkins-hbase4.apache.org/33837] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-20 07:12:08,754 DEBUG [Listener at jenkins-hbase4.apache.org/33837] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-20 07:12:08,754 DEBUG [Listener at jenkins-hbase4.apache.org/33837] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-20 07:12:08,755 DEBUG [Listener at jenkins-hbase4.apache.org/33837] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-20 07:12:08,756 DEBUG [Listener at jenkins-hbase4.apache.org/33837] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-20 07:12:08,756 DEBUG [Listener at jenkins-hbase4.apache.org/33837] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-20 07:12:08,757 DEBUG [Listener at jenkins-hbase4.apache.org/33837] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-20 07:12:08,757 DEBUG [Listener at jenkins-hbase4.apache.org/33837] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-20 07:12:08,758 DEBUG [Listener at jenkins-hbase4.apache.org/33837] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-20 07:12:08,764 DEBUG [Listener at jenkins-hbase4.apache.org/33837] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-20 07:12:08,765 DEBUG [Listener at jenkins-hbase4.apache.org/33837] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-20 07:12:08,766 DEBUG [Listener at jenkins-hbase4.apache.org/33837] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-20 07:12:08,766 DEBUG [Listener at jenkins-hbase4.apache.org/33837] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-20 07:12:08,767 DEBUG [Listener at jenkins-hbase4.apache.org/33837] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-20 07:12:08,767 DEBUG [Listener at jenkins-hbase4.apache.org/33837] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-20 07:12:08,767 DEBUG [Listener at jenkins-hbase4.apache.org/33837] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-20 07:12:08,767 DEBUG [Listener at jenkins-hbase4.apache.org/33837] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-20 07:12:08,768 DEBUG [Listener at jenkins-hbase4.apache.org/33837] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-20 07:12:08,984 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689837028633_0005_000001 (auth:SIMPLE) 2023-07-20 07:12:09,736 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-20 07:12:10,407 WARN [Listener at jenkins-hbase4.apache.org/33837] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-20 07:12:10,410 INFO [Listener at jenkins-hbase4.apache.org/33837] snapshot.ExportSnapshot(578): Loading Snapshot 'emptySnaptb0-testEmptyExportFileSystemState' hfile list 2023-07-20 07:12:10,598 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-20 07:12:10,598 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-20 07:12:10,999 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689837028633_0006_000001 (auth:SIMPLE) 2023-07-20 07:12:17,688 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689837028633_0006_000001 (auth:SIMPLE) 2023-07-20 07:12:20,744 INFO [Listener at jenkins-hbase4.apache.org/33837] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-20 07:12:20,745 INFO [Listener at jenkins-hbase4.apache.org/33837] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-20 07:12:20,754 INFO [Listener at jenkins-hbase4.apache.org/33837] snapshot.ExportSnapshot(1127): Export Completed: emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 07:12:20,754 INFO [Listener at jenkins-hbase4.apache.org/33837] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-20 07:12:20,755 INFO [Listener at jenkins-hbase4.apache.org/33837] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-20 07:12:20,755 DEBUG [Listener at jenkins-hbase4.apache.org/33837] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_759529442_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState at hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 07:12:20,760 DEBUG [Listener at jenkins-hbase4.apache.org/33837] snapshot.TestExportSnapshot(367): hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/.snapshotinfo 2023-07-20 07:12:20,760 DEBUG [Listener at jenkins-hbase4.apache.org/33837] snapshot.TestExportSnapshot(367): hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/data.manifest 2023-07-20 07:12:20,760 DEBUG [Listener at jenkins-hbase4.apache.org/33837] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_759529442_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/export-test/export-1689837128501/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState at hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/export-test/export-1689837128501/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 07:12:20,760 DEBUG [Listener at jenkins-hbase4.apache.org/33837] snapshot.TestExportSnapshot(367): hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/export-test/export-1689837128501/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/.snapshotinfo 2023-07-20 07:12:20,760 DEBUG [Listener at jenkins-hbase4.apache.org/33837] snapshot.TestExportSnapshot(367): hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/export-test/export-1689837128501/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/data.manifest 2023-07-20 07:12:20,766 INFO [Listener at jenkins-hbase4.apache.org/33837] client.HBaseAdmin$15(890): Started disable of testtb-testEmptyExportFileSystemState 2023-07-20 07:12:20,766 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testEmptyExportFileSystemState 2023-07-20 07:12:20,768 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] procedure2.ProcedureExecutor(1029): Stored pid=99, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-20 07:12:20,772 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-07-20 07:12:20,775 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689837140775"}]},"ts":"1689837140775"} 2023-07-20 07:12:20,777 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=DISABLING in hbase:meta 2023-07-20 07:12:20,779 INFO [PEWorker-1] procedure.DisableTableProcedure(293): Set testtb-testEmptyExportFileSystemState to state=DISABLING 2023-07-20 07:12:20,780 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=100, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=92a00c925bbc0b2fd5b0b5900d64b365, UNASSIGN}, {pid=101, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=cc1a31b2c1bbb19255945e06eefa045b, UNASSIGN}] 2023-07-20 07:12:20,784 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=100, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=92a00c925bbc0b2fd5b0b5900d64b365, UNASSIGN 2023-07-20 07:12:20,784 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=101, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=cc1a31b2c1bbb19255945e06eefa045b, UNASSIGN 2023-07-20 07:12:20,785 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=92a00c925bbc0b2fd5b0b5900d64b365, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,44777,1689837020621 2023-07-20 07:12:20,785 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=101 updating hbase:meta row=cc1a31b2c1bbb19255945e06eefa045b, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,45099,1689837020733 2023-07-20 07:12:20,785 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,,1689837124803.92a00c925bbc0b2fd5b0b5900d64b365.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689837140785"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689837140785"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689837140785"}]},"ts":"1689837140785"} 2023-07-20 07:12:20,785 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,1,1689837124803.cc1a31b2c1bbb19255945e06eefa045b.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689837140785"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689837140785"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689837140785"}]},"ts":"1689837140785"} 2023-07-20 07:12:20,787 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=102, ppid=100, state=RUNNABLE; CloseRegionProcedure 92a00c925bbc0b2fd5b0b5900d64b365, server=jenkins-hbase4.apache.org,44777,1689837020621}] 2023-07-20 07:12:20,788 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=103, ppid=101, state=RUNNABLE; CloseRegionProcedure cc1a31b2c1bbb19255945e06eefa045b, server=jenkins-hbase4.apache.org,45099,1689837020733}] 2023-07-20 07:12:20,873 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-07-20 07:12:20,944 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close cc1a31b2c1bbb19255945e06eefa045b 2023-07-20 07:12:20,944 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing cc1a31b2c1bbb19255945e06eefa045b, disabling compactions & flushes 2023-07-20 07:12:20,944 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,1,1689837124803.cc1a31b2c1bbb19255945e06eefa045b. 2023-07-20 07:12:20,944 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,1,1689837124803.cc1a31b2c1bbb19255945e06eefa045b. 2023-07-20 07:12:20,944 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,1,1689837124803.cc1a31b2c1bbb19255945e06eefa045b. after waiting 0 ms 2023-07-20 07:12:20,944 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,1,1689837124803.cc1a31b2c1bbb19255945e06eefa045b. 2023-07-20 07:12:20,944 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 92a00c925bbc0b2fd5b0b5900d64b365 2023-07-20 07:12:20,944 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 92a00c925bbc0b2fd5b0b5900d64b365, disabling compactions & flushes 2023-07-20 07:12:20,944 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,,1689837124803.92a00c925bbc0b2fd5b0b5900d64b365. 2023-07-20 07:12:20,944 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,,1689837124803.92a00c925bbc0b2fd5b0b5900d64b365. 2023-07-20 07:12:20,944 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,,1689837124803.92a00c925bbc0b2fd5b0b5900d64b365. after waiting 0 ms 2023-07-20 07:12:20,945 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,,1689837124803.92a00c925bbc0b2fd5b0b5900d64b365. 2023-07-20 07:12:20,959 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/data/default/testtb-testEmptyExportFileSystemState/cc1a31b2c1bbb19255945e06eefa045b/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-20 07:12:20,959 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/data/default/testtb-testEmptyExportFileSystemState/92a00c925bbc0b2fd5b0b5900d64b365/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-20 07:12:20,959 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-20 07:12:20,960 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,1,1689837124803.cc1a31b2c1bbb19255945e06eefa045b. 2023-07-20 07:12:20,960 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for cc1a31b2c1bbb19255945e06eefa045b: 2023-07-20 07:12:20,961 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-20 07:12:20,961 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,,1689837124803.92a00c925bbc0b2fd5b0b5900d64b365. 2023-07-20 07:12:20,962 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 92a00c925bbc0b2fd5b0b5900d64b365: 2023-07-20 07:12:20,963 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 92a00c925bbc0b2fd5b0b5900d64b365 2023-07-20 07:12:20,964 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=92a00c925bbc0b2fd5b0b5900d64b365, regionState=CLOSED 2023-07-20 07:12:20,964 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,,1689837124803.92a00c925bbc0b2fd5b0b5900d64b365.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689837140964"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689837140964"}]},"ts":"1689837140964"} 2023-07-20 07:12:20,964 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed cc1a31b2c1bbb19255945e06eefa045b 2023-07-20 07:12:20,964 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=101 updating hbase:meta row=cc1a31b2c1bbb19255945e06eefa045b, regionState=CLOSED 2023-07-20 07:12:20,965 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,1,1689837124803.cc1a31b2c1bbb19255945e06eefa045b.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689837140964"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689837140964"}]},"ts":"1689837140964"} 2023-07-20 07:12:20,967 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=102, resume processing ppid=100 2023-07-20 07:12:20,967 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=102, ppid=100, state=SUCCESS; CloseRegionProcedure 92a00c925bbc0b2fd5b0b5900d64b365, server=jenkins-hbase4.apache.org,44777,1689837020621 in 178 msec 2023-07-20 07:12:20,968 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=103, resume processing ppid=101 2023-07-20 07:12:20,968 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=103, ppid=101, state=SUCCESS; CloseRegionProcedure cc1a31b2c1bbb19255945e06eefa045b, server=jenkins-hbase4.apache.org,45099,1689837020733 in 178 msec 2023-07-20 07:12:20,969 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=100, ppid=99, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=92a00c925bbc0b2fd5b0b5900d64b365, UNASSIGN in 187 msec 2023-07-20 07:12:20,970 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=101, resume processing ppid=99 2023-07-20 07:12:20,970 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=101, ppid=99, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=cc1a31b2c1bbb19255945e06eefa045b, UNASSIGN in 188 msec 2023-07-20 07:12:20,971 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689837140971"}]},"ts":"1689837140971"} 2023-07-20 07:12:20,972 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=DISABLED in hbase:meta 2023-07-20 07:12:20,973 INFO [PEWorker-2] procedure.DisableTableProcedure(305): Set testtb-testEmptyExportFileSystemState to state=DISABLED 2023-07-20 07:12:20,975 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=99, state=SUCCESS; DisableTableProcedure table=testtb-testEmptyExportFileSystemState in 207 msec 2023-07-20 07:12:21,075 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-07-20 07:12:21,075 INFO [Listener at jenkins-hbase4.apache.org/33837] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 99 completed 2023-07-20 07:12:21,076 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testEmptyExportFileSystemState 2023-07-20 07:12:21,077 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] procedure2.ProcedureExecutor(1029): Stored pid=104, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-20 07:12:21,080 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=104, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-20 07:12:21,080 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] access.PermissionStorage(259): Removing permissions of removed table testtb-testEmptyExportFileSystemState 2023-07-20 07:12:21,081 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=104, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-20 07:12:21,082 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=44955] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testEmptyExportFileSystemState 2023-07-20 07:12:21,085 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/.tmp/data/default/testtb-testEmptyExportFileSystemState/cc1a31b2c1bbb19255945e06eefa045b 2023-07-20 07:12:21,085 DEBUG [HFileArchiver-21] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/.tmp/data/default/testtb-testEmptyExportFileSystemState/92a00c925bbc0b2fd5b0b5900d64b365 2023-07-20 07:12:21,087 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/.tmp/data/default/testtb-testEmptyExportFileSystemState/cc1a31b2c1bbb19255945e06eefa045b/cf, FileablePath, hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/.tmp/data/default/testtb-testEmptyExportFileSystemState/cc1a31b2c1bbb19255945e06eefa045b/recovered.edits] 2023-07-20 07:12:21,087 DEBUG [HFileArchiver-21] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/.tmp/data/default/testtb-testEmptyExportFileSystemState/92a00c925bbc0b2fd5b0b5900d64b365/cf, FileablePath, hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/.tmp/data/default/testtb-testEmptyExportFileSystemState/92a00c925bbc0b2fd5b0b5900d64b365/recovered.edits] 2023-07-20 07:12:21,089 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): master:37415-0x10181911f0f0000, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-20 07:12:21,089 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): regionserver:44955-0x10181911f0f0003, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-20 07:12:21,089 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): regionserver:45099-0x10181911f0f0002, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-20 07:12:21,090 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): regionserver:44777-0x10181911f0f0001, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-20 07:12:21,092 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/.tmp/data/default/testtb-testEmptyExportFileSystemState/cc1a31b2c1bbb19255945e06eefa045b/cf/6d5a76f522c248a49123caa980a113c4 to hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/archive/data/default/testtb-testEmptyExportFileSystemState/cc1a31b2c1bbb19255945e06eefa045b/cf/6d5a76f522c248a49123caa980a113c4 2023-07-20 07:12:21,092 DEBUG [HFileArchiver-21] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/.tmp/data/default/testtb-testEmptyExportFileSystemState/92a00c925bbc0b2fd5b0b5900d64b365/cf/755219923bd0415ba10eb05e95a792df to hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/archive/data/default/testtb-testEmptyExportFileSystemState/92a00c925bbc0b2fd5b0b5900d64b365/cf/755219923bd0415ba10eb05e95a792df 2023-07-20 07:12:21,093 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-07-20 07:12:21,093 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-07-20 07:12:21,093 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-07-20 07:12:21,093 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-07-20 07:12:21,095 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): regionserver:44955-0x10181911f0f0003, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-20 07:12:21,095 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): regionserver:45099-0x10181911f0f0002, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-20 07:12:21,095 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): regionserver:44955-0x10181911f0f0003, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-20 07:12:21,095 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): master:37415-0x10181911f0f0000, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-20 07:12:21,095 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): regionserver:44777-0x10181911f0f0001, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-20 07:12:21,095 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): regionserver:44777-0x10181911f0f0001, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-20 07:12:21,095 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): master:37415-0x10181911f0f0000, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-20 07:12:21,095 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): regionserver:45099-0x10181911f0f0002, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-20 07:12:21,096 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] master.MasterRpcServices(1230): Checking to see if procedure is done pid=104 2023-07-20 07:12:21,097 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/.tmp/data/default/testtb-testEmptyExportFileSystemState/cc1a31b2c1bbb19255945e06eefa045b/recovered.edits/9.seqid to hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/archive/data/default/testtb-testEmptyExportFileSystemState/cc1a31b2c1bbb19255945e06eefa045b/recovered.edits/9.seqid 2023-07-20 07:12:21,097 DEBUG [HFileArchiver-21] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/.tmp/data/default/testtb-testEmptyExportFileSystemState/92a00c925bbc0b2fd5b0b5900d64b365/recovered.edits/9.seqid to hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/archive/data/default/testtb-testEmptyExportFileSystemState/92a00c925bbc0b2fd5b0b5900d64b365/recovered.edits/9.seqid 2023-07-20 07:12:21,097 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/.tmp/data/default/testtb-testEmptyExportFileSystemState/cc1a31b2c1bbb19255945e06eefa045b 2023-07-20 07:12:21,098 DEBUG [HFileArchiver-21] backup.HFileArchiver(596): Deleted hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/.tmp/data/default/testtb-testEmptyExportFileSystemState/92a00c925bbc0b2fd5b0b5900d64b365 2023-07-20 07:12:21,098 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testEmptyExportFileSystemState regions 2023-07-20 07:12:21,098 DEBUG [PEWorker-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0 2023-07-20 07:12:21,099 DEBUG [PEWorker-3] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf] 2023-07-20 07:12:21,102 DEBUG [PEWorker-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b20230720cd120be9ff5e4106b8da8b7141ca9a18 to hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/archive/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b20230720cd120be9ff5e4106b8da8b7141ca9a18 2023-07-20 07:12:21,104 DEBUG [PEWorker-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e20230720c8a970c7cb264ee8911c597bfb8b7c2b to hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/archive/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e20230720c8a970c7cb264ee8911c597bfb8b7c2b 2023-07-20 07:12:21,104 DEBUG [PEWorker-3] backup.HFileArchiver(596): Deleted hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0 2023-07-20 07:12:21,107 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=104, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-20 07:12:21,110 WARN [PEWorker-3] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testEmptyExportFileSystemState from hbase:meta 2023-07-20 07:12:21,112 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(421): Removing 'testtb-testEmptyExportFileSystemState' descriptor. 2023-07-20 07:12:21,113 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=104, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-20 07:12:21,113 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(411): Removing 'testtb-testEmptyExportFileSystemState' from region states. 2023-07-20 07:12:21,113 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState,,1689837124803.92a00c925bbc0b2fd5b0b5900d64b365.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689837141113"}]},"ts":"9223372036854775807"} 2023-07-20 07:12:21,113 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState,1,1689837124803.cc1a31b2c1bbb19255945e06eefa045b.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689837141113"}]},"ts":"9223372036854775807"} 2023-07-20 07:12:21,115 INFO [PEWorker-3] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-20 07:12:21,115 DEBUG [PEWorker-3] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 92a00c925bbc0b2fd5b0b5900d64b365, NAME => 'testtb-testEmptyExportFileSystemState,,1689837124803.92a00c925bbc0b2fd5b0b5900d64b365.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => cc1a31b2c1bbb19255945e06eefa045b, NAME => 'testtb-testEmptyExportFileSystemState,1,1689837124803.cc1a31b2c1bbb19255945e06eefa045b.', STARTKEY => '1', ENDKEY => ''}] 2023-07-20 07:12:21,115 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(415): Marking 'testtb-testEmptyExportFileSystemState' as deleted. 2023-07-20 07:12:21,116 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689837141115"}]},"ts":"9223372036854775807"} 2023-07-20 07:12:21,121 INFO [PEWorker-3] hbase.MetaTableAccessor(1658): Deleted table testtb-testEmptyExportFileSystemState state from META 2023-07-20 07:12:21,131 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(130): Finished pid=104, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-20 07:12:21,132 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=104, state=SUCCESS; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState in 55 msec 2023-07-20 07:12:21,197 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] master.MasterRpcServices(1230): Checking to see if procedure is done pid=104 2023-07-20 07:12:21,198 INFO [Listener at jenkins-hbase4.apache.org/33837] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 104 completed 2023-07-20 07:12:21,207 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testEmptyExportFileSystemState" 2023-07-20 07:12:21,210 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 07:12:21,212 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testEmptyExportFileSystemState" 2023-07-20 07:12:21,214 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testEmptyExportFileSystemState 2023-07-20 07:12:21,241 INFO [Listener at jenkins-hbase4.apache.org/33837] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testEmptyExportFileSystemState Thread=761 (was 758) Potentially hanging thread: IPC Client (309353702) connection to jenkins-hbase4.apache.org/172.31.14.131:33837 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: ApplicationMasterLauncher #9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x7a39bf3a-shared-pool-37 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_759529442_17 at /127.0.0.1:41998 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-380005359_1 at /127.0.0.1:50004 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_759529442_17 at /127.0.0.1:53046 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x7a39bf3a-shared-pool-34 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-21 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x7a39bf3a-shared-pool-35 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_759529442_17 at /127.0.0.1:37690 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x7a39bf3a-shared-pool-36 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-380005359_1 at /127.0.0.1:36182 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-4791 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: IPC Client (309353702) connection to jenkins-hbase4.apache.org/172.31.14.131:35035 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) - Thread LEAK? -, OpenFileDescriptor=906 (was 904) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=604 (was 533) - SystemLoadAverage LEAK? -, ProcessCount=184 (was 184), AvailableMemoryMB=1210 (was 2053) 2023-07-20 07:12:21,241 WARN [Listener at jenkins-hbase4.apache.org/33837] hbase.ResourceChecker(130): Thread=761 is superior to 500 2023-07-20 07:12:21,263 INFO [Listener at jenkins-hbase4.apache.org/33837] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithSkipTmp Thread=761, OpenFileDescriptor=906, MaxFileDescriptor=60000, SystemLoadAverage=604, ProcessCount=184, AvailableMemoryMB=1209 2023-07-20 07:12:21,264 WARN [Listener at jenkins-hbase4.apache.org/33837] hbase.ResourceChecker(130): Thread=761 is superior to 500 2023-07-20 07:12:21,265 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-07-20 07:12:21,266 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] procedure2.ProcedureExecutor(1029): Stored pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-20 07:12:21,268 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_PRE_OPERATION 2023-07-20 07:12:21,269 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithSkipTmp" procId is: 105 2023-07-20 07:12:21,269 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-20 07:12:21,270 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-20 07:12:21,271 DEBUG [HFileArchiver-20] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/3210cdacd31df68ae51177f956c734a8 2023-07-20 07:12:21,271 DEBUG [HFileArchiver-19] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/337cbc3c1a07f8b7bf3b2f87c5ddc22a 2023-07-20 07:12:21,272 DEBUG [HFileArchiver-20] backup.HFileArchiver(153): Directory hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/3210cdacd31df68ae51177f956c734a8 empty. 2023-07-20 07:12:21,272 DEBUG [HFileArchiver-19] backup.HFileArchiver(153): Directory hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/337cbc3c1a07f8b7bf3b2f87c5ddc22a empty. 2023-07-20 07:12:21,272 DEBUG [HFileArchiver-20] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/3210cdacd31df68ae51177f956c734a8 2023-07-20 07:12:21,272 DEBUG [HFileArchiver-19] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/337cbc3c1a07f8b7bf3b2f87c5ddc22a 2023-07-20 07:12:21,272 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithSkipTmp regions 2023-07-20 07:12:21,289 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/.tabledesc/.tableinfo.0000000001 2023-07-20 07:12:21,290 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(7675): creating {ENCODED => 3210cdacd31df68ae51177f956c734a8, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1689837141265.3210cdacd31df68ae51177f956c734a8.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/.tmp 2023-07-20 07:12:21,290 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(7675): creating {ENCODED => 337cbc3c1a07f8b7bf3b2f87c5ddc22a, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1689837141265.337cbc3c1a07f8b7bf3b2f87c5ddc22a.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/.tmp 2023-07-20 07:12:21,310 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,,1689837141265.3210cdacd31df68ae51177f956c734a8.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-20 07:12:21,310 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1604): Closing 3210cdacd31df68ae51177f956c734a8, disabling compactions & flushes 2023-07-20 07:12:21,310 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,,1689837141265.3210cdacd31df68ae51177f956c734a8. 2023-07-20 07:12:21,311 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,,1689837141265.3210cdacd31df68ae51177f956c734a8. 2023-07-20 07:12:21,311 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,,1689837141265.3210cdacd31df68ae51177f956c734a8. after waiting 0 ms 2023-07-20 07:12:21,311 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,,1689837141265.3210cdacd31df68ae51177f956c734a8. 2023-07-20 07:12:21,311 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,,1689837141265.3210cdacd31df68ae51177f956c734a8. 2023-07-20 07:12:21,311 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1558): Region close journal for 3210cdacd31df68ae51177f956c734a8: 2023-07-20 07:12:21,315 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,1,1689837141265.337cbc3c1a07f8b7bf3b2f87c5ddc22a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-20 07:12:21,315 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1604): Closing 337cbc3c1a07f8b7bf3b2f87c5ddc22a, disabling compactions & flushes 2023-07-20 07:12:21,315 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,1,1689837141265.337cbc3c1a07f8b7bf3b2f87c5ddc22a. 2023-07-20 07:12:21,315 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1689837141265.337cbc3c1a07f8b7bf3b2f87c5ddc22a. 2023-07-20 07:12:21,315 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1689837141265.337cbc3c1a07f8b7bf3b2f87c5ddc22a. after waiting 0 ms 2023-07-20 07:12:21,316 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,1,1689837141265.337cbc3c1a07f8b7bf3b2f87c5ddc22a. 2023-07-20 07:12:21,316 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,1,1689837141265.337cbc3c1a07f8b7bf3b2f87c5ddc22a. 2023-07-20 07:12:21,316 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1558): Region close journal for 337cbc3c1a07f8b7bf3b2f87c5ddc22a: 2023-07-20 07:12:21,318 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_ADD_TO_META 2023-07-20 07:12:21,319 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689837141265.3210cdacd31df68ae51177f956c734a8.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689837141319"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689837141319"}]},"ts":"1689837141319"} 2023-07-20 07:12:21,319 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689837141265.337cbc3c1a07f8b7bf3b2f87c5ddc22a.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689837141319"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689837141319"}]},"ts":"1689837141319"} 2023-07-20 07:12:21,322 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-20 07:12:21,323 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-20 07:12:21,323 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689837141323"}]},"ts":"1689837141323"} 2023-07-20 07:12:21,325 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=ENABLING in hbase:meta 2023-07-20 07:12:21,329 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-20 07:12:21,330 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-20 07:12:21,330 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-20 07:12:21,330 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-20 07:12:21,330 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-20 07:12:21,331 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=3210cdacd31df68ae51177f956c734a8, ASSIGN}, {pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=337cbc3c1a07f8b7bf3b2f87c5ddc22a, ASSIGN}] 2023-07-20 07:12:21,333 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=337cbc3c1a07f8b7bf3b2f87c5ddc22a, ASSIGN 2023-07-20 07:12:21,333 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=3210cdacd31df68ae51177f956c734a8, ASSIGN 2023-07-20 07:12:21,334 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=337cbc3c1a07f8b7bf3b2f87c5ddc22a, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,44955,1689837020792; forceNewPlan=false, retain=false 2023-07-20 07:12:21,334 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=3210cdacd31df68ae51177f956c734a8, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,44777,1689837020621; forceNewPlan=false, retain=false 2023-07-20 07:12:21,371 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-20 07:12:21,484 INFO [jenkins-hbase4:37415] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-20 07:12:21,488 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=3210cdacd31df68ae51177f956c734a8, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,44777,1689837020621 2023-07-20 07:12:21,488 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=337cbc3c1a07f8b7bf3b2f87c5ddc22a, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,44955,1689837020792 2023-07-20 07:12:21,488 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689837141265.3210cdacd31df68ae51177f956c734a8.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689837141488"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689837141488"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689837141488"}]},"ts":"1689837141488"} 2023-07-20 07:12:21,488 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689837141265.337cbc3c1a07f8b7bf3b2f87c5ddc22a.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689837141488"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689837141488"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689837141488"}]},"ts":"1689837141488"} 2023-07-20 07:12:21,490 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=108, ppid=106, state=RUNNABLE; OpenRegionProcedure 3210cdacd31df68ae51177f956c734a8, server=jenkins-hbase4.apache.org,44777,1689837020621}] 2023-07-20 07:12:21,491 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=109, ppid=107, state=RUNNABLE; OpenRegionProcedure 337cbc3c1a07f8b7bf3b2f87c5ddc22a, server=jenkins-hbase4.apache.org,44955,1689837020792}] 2023-07-20 07:12:21,572 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-20 07:12:21,649 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithSkipTmp,,1689837141265.3210cdacd31df68ae51177f956c734a8. 2023-07-20 07:12:21,649 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithSkipTmp,1,1689837141265.337cbc3c1a07f8b7bf3b2f87c5ddc22a. 2023-07-20 07:12:21,649 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 3210cdacd31df68ae51177f956c734a8, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1689837141265.3210cdacd31df68ae51177f956c734a8.', STARTKEY => '', ENDKEY => '1'} 2023-07-20 07:12:21,649 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 337cbc3c1a07f8b7bf3b2f87c5ddc22a, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1689837141265.337cbc3c1a07f8b7bf3b2f87c5ddc22a.', STARTKEY => '1', ENDKEY => ''} 2023-07-20 07:12:21,650 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithSkipTmp,,1689837141265.3210cdacd31df68ae51177f956c734a8. service=AccessControlService 2023-07-20 07:12:21,650 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithSkipTmp,1,1689837141265.337cbc3c1a07f8b7bf3b2f87c5ddc22a. service=AccessControlService 2023-07-20 07:12:21,650 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-20 07:12:21,650 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-20 07:12:21,650 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithSkipTmp 3210cdacd31df68ae51177f956c734a8 2023-07-20 07:12:21,650 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithSkipTmp 337cbc3c1a07f8b7bf3b2f87c5ddc22a 2023-07-20 07:12:21,650 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,,1689837141265.3210cdacd31df68ae51177f956c734a8.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-20 07:12:21,650 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,1,1689837141265.337cbc3c1a07f8b7bf3b2f87c5ddc22a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-20 07:12:21,650 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 3210cdacd31df68ae51177f956c734a8 2023-07-20 07:12:21,650 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 337cbc3c1a07f8b7bf3b2f87c5ddc22a 2023-07-20 07:12:21,650 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 3210cdacd31df68ae51177f956c734a8 2023-07-20 07:12:21,651 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 337cbc3c1a07f8b7bf3b2f87c5ddc22a 2023-07-20 07:12:21,652 INFO [StoreOpener-337cbc3c1a07f8b7bf3b2f87c5ddc22a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 337cbc3c1a07f8b7bf3b2f87c5ddc22a 2023-07-20 07:12:21,652 INFO [StoreOpener-3210cdacd31df68ae51177f956c734a8-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 3210cdacd31df68ae51177f956c734a8 2023-07-20 07:12:21,653 DEBUG [StoreOpener-337cbc3c1a07f8b7bf3b2f87c5ddc22a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/data/default/testtb-testExportFileSystemStateWithSkipTmp/337cbc3c1a07f8b7bf3b2f87c5ddc22a/cf 2023-07-20 07:12:21,653 DEBUG [StoreOpener-3210cdacd31df68ae51177f956c734a8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/data/default/testtb-testExportFileSystemStateWithSkipTmp/3210cdacd31df68ae51177f956c734a8/cf 2023-07-20 07:12:21,653 DEBUG [StoreOpener-3210cdacd31df68ae51177f956c734a8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/data/default/testtb-testExportFileSystemStateWithSkipTmp/3210cdacd31df68ae51177f956c734a8/cf 2023-07-20 07:12:21,653 DEBUG [StoreOpener-337cbc3c1a07f8b7bf3b2f87c5ddc22a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/data/default/testtb-testExportFileSystemStateWithSkipTmp/337cbc3c1a07f8b7bf3b2f87c5ddc22a/cf 2023-07-20 07:12:21,653 INFO [StoreOpener-337cbc3c1a07f8b7bf3b2f87c5ddc22a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 337cbc3c1a07f8b7bf3b2f87c5ddc22a columnFamilyName cf 2023-07-20 07:12:21,653 INFO [StoreOpener-3210cdacd31df68ae51177f956c734a8-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 3210cdacd31df68ae51177f956c734a8 columnFamilyName cf 2023-07-20 07:12:21,655 INFO [StoreOpener-337cbc3c1a07f8b7bf3b2f87c5ddc22a-1] regionserver.HStore(310): Store=337cbc3c1a07f8b7bf3b2f87c5ddc22a/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-20 07:12:21,655 INFO [StoreOpener-3210cdacd31df68ae51177f956c734a8-1] regionserver.HStore(310): Store=3210cdacd31df68ae51177f956c734a8/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-20 07:12:21,656 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/data/default/testtb-testExportFileSystemStateWithSkipTmp/337cbc3c1a07f8b7bf3b2f87c5ddc22a 2023-07-20 07:12:21,656 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/data/default/testtb-testExportFileSystemStateWithSkipTmp/3210cdacd31df68ae51177f956c734a8 2023-07-20 07:12:21,656 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/data/default/testtb-testExportFileSystemStateWithSkipTmp/337cbc3c1a07f8b7bf3b2f87c5ddc22a 2023-07-20 07:12:21,656 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/data/default/testtb-testExportFileSystemStateWithSkipTmp/3210cdacd31df68ae51177f956c734a8 2023-07-20 07:12:21,659 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 3210cdacd31df68ae51177f956c734a8 2023-07-20 07:12:21,660 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 337cbc3c1a07f8b7bf3b2f87c5ddc22a 2023-07-20 07:12:21,661 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/data/default/testtb-testExportFileSystemStateWithSkipTmp/3210cdacd31df68ae51177f956c734a8/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-20 07:12:21,662 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 3210cdacd31df68ae51177f956c734a8; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65212799, jitterRate=-0.028253570199012756}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-20 07:12:21,662 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 3210cdacd31df68ae51177f956c734a8: 2023-07-20 07:12:21,662 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/data/default/testtb-testExportFileSystemStateWithSkipTmp/337cbc3c1a07f8b7bf3b2f87c5ddc22a/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-20 07:12:21,663 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithSkipTmp,,1689837141265.3210cdacd31df68ae51177f956c734a8., pid=108, masterSystemTime=1689837141643 2023-07-20 07:12:21,663 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 337cbc3c1a07f8b7bf3b2f87c5ddc22a; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67523176, jitterRate=0.00617372989654541}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-20 07:12:21,663 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 337cbc3c1a07f8b7bf3b2f87c5ddc22a: 2023-07-20 07:12:21,663 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithSkipTmp,1,1689837141265.337cbc3c1a07f8b7bf3b2f87c5ddc22a., pid=109, masterSystemTime=1689837141643 2023-07-20 07:12:21,665 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithSkipTmp,,1689837141265.3210cdacd31df68ae51177f956c734a8. 2023-07-20 07:12:21,665 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithSkipTmp,,1689837141265.3210cdacd31df68ae51177f956c734a8. 2023-07-20 07:12:21,665 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=3210cdacd31df68ae51177f956c734a8, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,44777,1689837020621 2023-07-20 07:12:21,666 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithSkipTmp,1,1689837141265.337cbc3c1a07f8b7bf3b2f87c5ddc22a. 2023-07-20 07:12:21,666 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithSkipTmp,1,1689837141265.337cbc3c1a07f8b7bf3b2f87c5ddc22a. 2023-07-20 07:12:21,666 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689837141265.3210cdacd31df68ae51177f956c734a8.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689837141665"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689837141665"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689837141665"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689837141665"}]},"ts":"1689837141665"} 2023-07-20 07:12:21,666 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=337cbc3c1a07f8b7bf3b2f87c5ddc22a, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,44955,1689837020792 2023-07-20 07:12:21,666 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689837141265.337cbc3c1a07f8b7bf3b2f87c5ddc22a.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689837141666"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689837141666"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689837141666"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689837141666"}]},"ts":"1689837141666"} 2023-07-20 07:12:21,669 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=108, resume processing ppid=106 2023-07-20 07:12:21,669 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=108, ppid=106, state=SUCCESS; OpenRegionProcedure 3210cdacd31df68ae51177f956c734a8, server=jenkins-hbase4.apache.org,44777,1689837020621 in 177 msec 2023-07-20 07:12:21,670 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=109, resume processing ppid=107 2023-07-20 07:12:21,670 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=109, ppid=107, state=SUCCESS; OpenRegionProcedure 337cbc3c1a07f8b7bf3b2f87c5ddc22a, server=jenkins-hbase4.apache.org,44955,1689837020792 in 177 msec 2023-07-20 07:12:21,670 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=106, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=3210cdacd31df68ae51177f956c734a8, ASSIGN in 338 msec 2023-07-20 07:12:21,671 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=107, resume processing ppid=105 2023-07-20 07:12:21,672 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=107, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=337cbc3c1a07f8b7bf3b2f87c5ddc22a, ASSIGN in 339 msec 2023-07-20 07:12:21,672 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-20 07:12:21,672 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689837141672"}]},"ts":"1689837141672"} 2023-07-20 07:12:21,674 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=ENABLED in hbase:meta 2023-07-20 07:12:21,676 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_POST_OPERATION 2023-07-20 07:12:21,676 DEBUG [PEWorker-5] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithSkipTmp jenkins: RWXCA 2023-07-20 07:12:21,678 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=44955] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-07-20 07:12:21,679 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): regionserver:44777-0x10181911f0f0001, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-20 07:12:21,679 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): master:37415-0x10181911f0f0000, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-20 07:12:21,679 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): regionserver:45099-0x10181911f0f0002, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-20 07:12:21,680 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): regionserver:44955-0x10181911f0f0003, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-20 07:12:21,682 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): regionserver:45099-0x10181911f0f0002, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-20 07:12:21,682 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): master:37415-0x10181911f0f0000, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-20 07:12:21,682 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-07-20 07:12:21,683 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-07-20 07:12:21,683 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-07-20 07:12:21,685 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=105, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 418 msec 2023-07-20 07:12:21,686 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): regionserver:44777-0x10181911f0f0001, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-20 07:12:21,687 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-07-20 07:12:21,873 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-20 07:12:21,874 INFO [Listener at jenkins-hbase4.apache.org/33837] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 105 completed 2023-07-20 07:12:21,876 DEBUG [Listener at jenkins-hbase4.apache.org/33837] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithSkipTmp 2023-07-20 07:12:21,876 DEBUG [Listener at jenkins-hbase4.apache.org/33837] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithSkipTmp,,1689837141265.3210cdacd31df68ae51177f956c734a8. 2023-07-20 07:12:21,878 INFO [Listener at jenkins-hbase4.apache.org/33837] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-20 07:12:21,892 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-20 07:12:21,892 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689837141892 (current time:1689837141892). 2023-07-20 07:12:21,892 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-20 07:12:21,893 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] zookeeper.ReadOnlyZKClient(139): Connect 0x008bd398 to 127.0.0.1:58010 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-20 07:12:21,900 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@75823f, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-20 07:12:21,901 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-20 07:12:21,904 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:57478, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-20 07:12:21,905 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x008bd398 to 127.0.0.1:58010 2023-07-20 07:12:21,905 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-20 07:12:21,905 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] zookeeper.ReadOnlyZKClient(139): Connect 0x47462ef8 to 127.0.0.1:58010 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-20 07:12:21,910 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@198f229b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-20 07:12:21,911 DEBUG [hconnection-0x35472fef-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-20 07:12:21,919 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:57488, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-20 07:12:21,922 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-20 07:12:21,925 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:37740, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-20 07:12:21,926 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x47462ef8 to 127.0.0.1:58010 2023-07-20 07:12:21,926 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-20 07:12:21,926 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-07-20 07:12:21,927 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-20 07:12:21,927 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-20 07:12:21,929 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] procedure2.ProcedureExecutor(1029): Stored pid=110, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-20 07:12:21,930 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=110, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-20 07:12:21,931 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=110, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE; timeout=600000, timestamp=1689837741931 2023-07-20 07:12:21,931 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp 2023-07-20 07:12:21,931 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-20 07:12:21,933 DEBUG [Listener at jenkins-hbase4.apache.org/33837] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-20 07:12:21,933 DEBUG [Listener at jenkins-hbase4.apache.org/33837] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-20 07:12:21,934 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=110, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-20 07:12:21,934 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=111, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-20 07:12:21,935 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=110, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE in 5 msec 2023-07-20 07:12:21,936 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=111, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-20 07:12:21,936 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=111, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED; timeout=600000, timestamp=1689837741936 2023-07-20 07:12:21,944 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 07:12:21,944 INFO [(jenkins-hbase4.apache.org,37415,1689837019114)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' 2023-07-20 07:12:21,944 DEBUG [(jenkins-hbase4.apache.org,37415,1689837019114)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-20 07:12:21,946 DEBUG [(jenkins-hbase4.apache.org,37415,1689837019114)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' 2023-07-20 07:12:21,946 DEBUG [(jenkins-hbase4.apache.org,37415,1689837019114)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp', kicking off acquire phase on members. 2023-07-20 07:12:21,946 DEBUG [(jenkins-hbase4.apache.org,37415,1689837019114)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37415-0x10181911f0f0000, quorum=127.0.0.1:58010, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 07:12:21,946 DEBUG [(jenkins-hbase4.apache.org,37415,1689837019114)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 07:12:21,947 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): regionserver:45099-0x10181911f0f0002, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 07:12:21,947 DEBUG [(jenkins-hbase4.apache.org,37415,1689837019114)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44777,1689837020621 2023-07-20 07:12:21,947 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 07:12:21,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 07:12:21,947 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): regionserver:44777-0x10181911f0f0001, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 07:12:21,947 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): regionserver:44955-0x10181911f0f0003, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 07:12:21,948 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 07:12:21,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 07:12:21,948 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 07:12:21,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 07:12:21,948 DEBUG [(jenkins-hbase4.apache.org,37415,1689837019114)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37415-0x10181911f0f0000, quorum=127.0.0.1:58010, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44777,1689837020621 2023-07-20 07:12:21,948 DEBUG [(jenkins-hbase4.apache.org,37415,1689837019114)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44955,1689837020792 2023-07-20 07:12:21,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 07:12:21,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 07:12:21,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 07:12:21,948 DEBUG [(jenkins-hbase4.apache.org,37415,1689837019114)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37415-0x10181911f0f0000, quorum=127.0.0.1:58010, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44955,1689837020792 2023-07-20 07:12:21,948 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44777-0x10181911f0f0001, quorum=127.0.0.1:58010, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 07:12:21,948 DEBUG [(jenkins-hbase4.apache.org,37415,1689837019114)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-20 07:12:21,948 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45099-0x10181911f0f0002, quorum=127.0.0.1:58010, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 07:12:21,949 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44955-0x10181911f0f0003, quorum=127.0.0.1:58010, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 07:12:21,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-07-20 07:12:21,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 07:12:21,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-07-20 07:12:21,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 07:12:21,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-07-20 07:12:21,949 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-20 07:12:21,949 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-20 07:12:21,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 07:12:21,949 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-20 07:12:21,949 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 07:12:21,949 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 07:12:21,949 DEBUG [member: 'jenkins-hbase4.apache.org,44777,1689837020621' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-20 07:12:21,949 DEBUG [member: 'jenkins-hbase4.apache.org,45099,1689837020733' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-20 07:12:21,949 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 07:12:21,949 DEBUG [member: 'jenkins-hbase4.apache.org,45099,1689837020733' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-20 07:12:21,949 DEBUG [member: 'jenkins-hbase4.apache.org,44777,1689837020621' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-20 07:12:21,951 DEBUG [member: 'jenkins-hbase4.apache.org,45099,1689837020733' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-20 07:12:21,952 DEBUG [member: 'jenkins-hbase4.apache.org,44777,1689837020621' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-20 07:12:21,952 DEBUG [member: 'jenkins-hbase4.apache.org,44777,1689837020621' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-20 07:12:21,952 DEBUG [member: 'jenkins-hbase4.apache.org,44777,1689837020621' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44777,1689837020621' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-20 07:12:21,950 DEBUG [member: 'jenkins-hbase4.apache.org,44955,1689837020792' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-20 07:12:21,952 DEBUG [member: 'jenkins-hbase4.apache.org,45099,1689837020733' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-20 07:12:21,952 DEBUG [member: 'jenkins-hbase4.apache.org,44955,1689837020792' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-20 07:12:21,952 DEBUG [member: 'jenkins-hbase4.apache.org,45099,1689837020733' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45099,1689837020733' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-20 07:12:21,953 DEBUG [member: 'jenkins-hbase4.apache.org,44955,1689837020792' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-20 07:12:21,953 DEBUG [member: 'jenkins-hbase4.apache.org,44955,1689837020792' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-20 07:12:21,953 DEBUG [member: 'jenkins-hbase4.apache.org,44955,1689837020792' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44955,1689837020792' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-20 07:12:21,959 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): master:37415-0x10181911f0f0000, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44777,1689837020621 2023-07-20 07:12:21,959 DEBUG [member: 'jenkins-hbase4.apache.org,44777,1689837020621' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 07:12:21,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44777,1689837020621 2023-07-20 07:12:21,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-20 07:12:21,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-20 07:12:21,960 DEBUG [member: 'jenkins-hbase4.apache.org,45099,1689837020733' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 07:12:21,960 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): master:37415-0x10181911f0f0000, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44955,1689837020792 2023-07-20 07:12:21,960 DEBUG [member: 'jenkins-hbase4.apache.org,44777,1689837020621' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44777-0x10181911f0f0001, quorum=127.0.0.1:58010, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 07:12:21,960 DEBUG [member: 'jenkins-hbase4.apache.org,44777,1689837020621' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-20 07:12:21,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-20 07:12:21,960 DEBUG [member: 'jenkins-hbase4.apache.org,44955,1689837020792' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 07:12:21,960 DEBUG [member: 'jenkins-hbase4.apache.org,45099,1689837020733' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45099-0x10181911f0f0002, quorum=127.0.0.1:58010, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 07:12:21,960 DEBUG [member: 'jenkins-hbase4.apache.org,45099,1689837020733' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-20 07:12:21,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-20 07:12:21,960 DEBUG [member: 'jenkins-hbase4.apache.org,44955,1689837020792' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44955-0x10181911f0f0003, quorum=127.0.0.1:58010, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 07:12:21,960 DEBUG [member: 'jenkins-hbase4.apache.org,44955,1689837020792' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-20 07:12:21,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 07:12:21,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44955,1689837020792 2023-07-20 07:12:21,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44777,1689837020621 2023-07-20 07:12:21,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45099,1689837020733 2023-07-20 07:12:21,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-20 07:12:21,962 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44777,1689837020621' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-07-20 07:12:21,962 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@ea7af25[Count = 1] remaining members to acquire global barrier 2023-07-20 07:12:21,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44955,1689837020792 2023-07-20 07:12:21,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-20 07:12:21,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-20 07:12:21,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-20 07:12:21,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-20 07:12:21,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 07:12:21,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44955,1689837020792 2023-07-20 07:12:21,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44777,1689837020621 2023-07-20 07:12:21,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45099,1689837020733 2023-07-20 07:12:21,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-20 07:12:21,964 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44955,1689837020792' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-07-20 07:12:21,964 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@ea7af25[Count = 0] remaining members to acquire global barrier 2023-07-20 07:12:21,964 DEBUG [(jenkins-hbase4.apache.org,37415,1689837019114)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'in-barrier' execution. 2023-07-20 07:12:21,964 DEBUG [(jenkins-hbase4.apache.org,37415,1689837019114)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 07:12:21,965 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): regionserver:44777-0x10181911f0f0001, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 07:12:21,965 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): regionserver:44955-0x10181911f0f0003, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 07:12:21,965 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 07:12:21,965 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 07:12:21,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 07:12:21,965 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): regionserver:45099-0x10181911f0f0002, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 07:12:21,965 DEBUG [member: 'jenkins-hbase4.apache.org,44955,1689837020792' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-20 07:12:21,965 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 07:12:21,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 07:12:21,965 DEBUG [(jenkins-hbase4.apache.org,37415,1689837019114)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37415-0x10181911f0f0000, quorum=127.0.0.1:58010, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44777,1689837020621 2023-07-20 07:12:21,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 07:12:21,965 DEBUG [member: 'jenkins-hbase4.apache.org,44955,1689837020792' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-20 07:12:21,966 DEBUG [member: 'jenkins-hbase4.apache.org,44955,1689837020792' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-20 07:12:21,965 DEBUG [member: 'jenkins-hbase4.apache.org,45099,1689837020733' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-20 07:12:21,966 DEBUG [member: 'jenkins-hbase4.apache.org,45099,1689837020733' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-20 07:12:21,965 DEBUG [rs(jenkins-hbase4.apache.org,44955,1689837020792)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1689837141265.337cbc3c1a07f8b7bf3b2f87c5ddc22a. 2023-07-20 07:12:21,965 DEBUG [member: 'jenkins-hbase4.apache.org,44777,1689837020621' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-20 07:12:21,966 DEBUG [rs(jenkins-hbase4.apache.org,44955,1689837020792)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1689837141265.337cbc3c1a07f8b7bf3b2f87c5ddc22a. started... 2023-07-20 07:12:21,966 DEBUG [member: 'jenkins-hbase4.apache.org,45099,1689837020733' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,45099,1689837020733' in zk 2023-07-20 07:12:21,966 DEBUG [member: 'jenkins-hbase4.apache.org,44777,1689837020621' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-20 07:12:21,966 DEBUG [member: 'jenkins-hbase4.apache.org,44777,1689837020621' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-20 07:12:21,966 DEBUG [rs(jenkins-hbase4.apache.org,44777,1689837020621)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1689837141265.3210cdacd31df68ae51177f956c734a8. 2023-07-20 07:12:21,966 DEBUG [rs(jenkins-hbase4.apache.org,44777,1689837020621)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1689837141265.3210cdacd31df68ae51177f956c734a8. started... 2023-07-20 07:12:21,966 DEBUG [(jenkins-hbase4.apache.org,37415,1689837019114)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37415-0x10181911f0f0000, quorum=127.0.0.1:58010, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44955,1689837020792 2023-07-20 07:12:21,966 DEBUG [(jenkins-hbase4.apache.org,37415,1689837019114)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-20 07:12:21,966 DEBUG [rs(jenkins-hbase4.apache.org,44777,1689837020621)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 3210cdacd31df68ae51177f956c734a8: 2023-07-20 07:12:21,967 DEBUG [rs(jenkins-hbase4.apache.org,44777,1689837020621)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,,1689837141265.3210cdacd31df68ae51177f956c734a8.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 07:12:21,967 DEBUG [rs(jenkins-hbase4.apache.org,44777,1689837020621)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-20 07:12:21,967 DEBUG [rs(jenkins-hbase4.apache.org,44777,1689837020621)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-20 07:12:21,970 DEBUG [member: 'jenkins-hbase4.apache.org,45099,1689837020733' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-20 07:12:21,970 DEBUG [member: 'jenkins-hbase4.apache.org,45099,1689837020733' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-20 07:12:21,970 DEBUG [member: 'jenkins-hbase4.apache.org,45099,1689837020733' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-20 07:12:21,975 DEBUG [rs(jenkins-hbase4.apache.org,44955,1689837020792)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 337cbc3c1a07f8b7bf3b2f87c5ddc22a: 2023-07-20 07:12:21,976 DEBUG [rs(jenkins-hbase4.apache.org,44955,1689837020792)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,1,1689837141265.337cbc3c1a07f8b7bf3b2f87c5ddc22a.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 07:12:21,976 DEBUG [rs(jenkins-hbase4.apache.org,44955,1689837020792)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-20 07:12:21,976 DEBUG [rs(jenkins-hbase4.apache.org,44955,1689837020792)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-20 07:12:21,992 DEBUG [rs(jenkins-hbase4.apache.org,44777,1689837020621)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1689837141265.3210cdacd31df68ae51177f956c734a8. completed. 2023-07-20 07:12:21,992 DEBUG [rs(jenkins-hbase4.apache.org,44777,1689837020621)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1689837141265.3210cdacd31df68ae51177f956c734a8. 2023-07-20 07:12:21,992 DEBUG [member: 'jenkins-hbase4.apache.org,44777,1689837020621' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-20 07:12:21,992 DEBUG [member: 'jenkins-hbase4.apache.org,44777,1689837020621' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-20 07:12:21,992 DEBUG [member: 'jenkins-hbase4.apache.org,44777,1689837020621' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,44777,1689837020621 2023-07-20 07:12:21,992 DEBUG [member: 'jenkins-hbase4.apache.org,44777,1689837020621' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-20 07:12:21,992 DEBUG [member: 'jenkins-hbase4.apache.org,44777,1689837020621' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,44777,1689837020621' in zk 2023-07-20 07:12:21,994 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): master:37415-0x10181911f0f0000, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44777,1689837020621 2023-07-20 07:12:21,994 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44777,1689837020621 2023-07-20 07:12:21,994 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-20 07:12:21,994 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-20 07:12:21,994 DEBUG [member: 'jenkins-hbase4.apache.org,44777,1689837020621' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-20 07:12:21,994 DEBUG [member: 'jenkins-hbase4.apache.org,44777,1689837020621' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-20 07:12:21,994 DEBUG [member: 'jenkins-hbase4.apache.org,44777,1689837020621' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-20 07:12:21,996 DEBUG [rs(jenkins-hbase4.apache.org,44955,1689837020792)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1689837141265.337cbc3c1a07f8b7bf3b2f87c5ddc22a. completed. 2023-07-20 07:12:21,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-20 07:12:21,996 DEBUG [rs(jenkins-hbase4.apache.org,44955,1689837020792)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1689837141265.337cbc3c1a07f8b7bf3b2f87c5ddc22a. 2023-07-20 07:12:21,996 DEBUG [member: 'jenkins-hbase4.apache.org,44955,1689837020792' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-20 07:12:21,996 DEBUG [member: 'jenkins-hbase4.apache.org,44955,1689837020792' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-20 07:12:21,996 DEBUG [member: 'jenkins-hbase4.apache.org,44955,1689837020792' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,44955,1689837020792 2023-07-20 07:12:21,996 DEBUG [member: 'jenkins-hbase4.apache.org,44955,1689837020792' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-20 07:12:21,996 DEBUG [member: 'jenkins-hbase4.apache.org,44955,1689837020792' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,44955,1689837020792' in zk 2023-07-20 07:12:21,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-20 07:12:21,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 07:12:21,998 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): master:37415-0x10181911f0f0000, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44955,1689837020792 2023-07-20 07:12:21,998 DEBUG [member: 'jenkins-hbase4.apache.org,44955,1689837020792' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-20 07:12:21,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44955,1689837020792 2023-07-20 07:12:21,998 DEBUG [member: 'jenkins-hbase4.apache.org,44955,1689837020792' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-20 07:12:21,998 DEBUG [member: 'jenkins-hbase4.apache.org,44955,1689837020792' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-20 07:12:22,000 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44777,1689837020621 2023-07-20 07:12:22,000 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45099,1689837020733 2023-07-20 07:12:22,000 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-20 07:12:22,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 07:12:22,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44955,1689837020792 2023-07-20 07:12:22,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44777,1689837020621 2023-07-20 07:12:22,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45099,1689837020733 2023-07-20 07:12:22,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,44777,1689837020621': 2023-07-20 07:12:22,002 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44777,1689837020621' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 1 more 2023-07-20 07:12:22,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44955,1689837020792 2023-07-20 07:12:22,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-20 07:12:22,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-20 07:12:22,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-20 07:12:22,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-20 07:12:22,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 07:12:22,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44955,1689837020792 2023-07-20 07:12:22,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44777,1689837020621 2023-07-20 07:12:22,004 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45099,1689837020733 2023-07-20 07:12:22,004 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-20 07:12:22,004 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 07:12:22,004 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44955,1689837020792 2023-07-20 07:12:22,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44777,1689837020621 2023-07-20 07:12:22,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45099,1689837020733 2023-07-20 07:12:22,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,44955,1689837020792': 2023-07-20 07:12:22,005 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44955,1689837020792' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 0 more 2023-07-20 07:12:22,005 INFO [(jenkins-hbase4.apache.org,37415,1689837019114)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' execution completed 2023-07-20 07:12:22,005 DEBUG [(jenkins-hbase4.apache.org,37415,1689837019114)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-20 07:12:22,005 DEBUG [(jenkins-hbase4.apache.org,37415,1689837019114)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-20 07:12:22,005 DEBUG [(jenkins-hbase4.apache.org,37415,1689837019114)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 07:12:22,005 INFO [(jenkins-hbase4.apache.org,37415,1689837019114)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateWithSkipTmpincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-20 07:12:22,007 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): regionserver:45099-0x10181911f0f0002, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 07:12:22,007 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): master:37415-0x10181911f0f0000, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 07:12:22,007 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 07:12:22,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 07:12:22,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-20 07:12:22,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-20 07:12:22,007 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): regionserver:44955-0x10181911f0f0003, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 07:12:22,007 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): regionserver:44777-0x10181911f0f0001, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 07:12:22,008 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 07:12:22,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 07:12:22,008 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 07:12:22,007 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): regionserver:45099-0x10181911f0f0002, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 07:12:22,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 07:12:22,008 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): regionserver:44777-0x10181911f0f0001, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 07:12:22,008 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): regionserver:44955-0x10181911f0f0003, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 07:12:22,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 07:12:22,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-20 07:12:22,010 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 07:12:22,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 07:12:22,010 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 07:12:22,010 DEBUG [(jenkins-hbase4.apache.org,37415,1689837019114)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37415-0x10181911f0f0000, quorum=127.0.0.1:58010, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44955,1689837020792 2023-07-20 07:12:22,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 07:12:22,010 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 07:12:22,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 07:12:22,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 07:12:22,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 07:12:22,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 07:12:22,010 DEBUG [(jenkins-hbase4.apache.org,37415,1689837019114)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37415-0x10181911f0f0000, quorum=127.0.0.1:58010, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44777,1689837020621 2023-07-20 07:12:22,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-20 07:12:22,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 07:12:22,011 DEBUG [(jenkins-hbase4.apache.org,37415,1689837019114)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37415-0x10181911f0f0000, quorum=127.0.0.1:58010, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45099,1689837020733 2023-07-20 07:12:22,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 07:12:22,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44955,1689837020792 2023-07-20 07:12:22,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44777,1689837020621 2023-07-20 07:12:22,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45099,1689837020733 2023-07-20 07:12:22,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-20 07:12:22,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 07:12:22,012 DEBUG [(jenkins-hbase4.apache.org,37415,1689837019114)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37415-0x10181911f0f0000, quorum=127.0.0.1:58010, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44955,1689837020792 2023-07-20 07:12:22,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44955,1689837020792 2023-07-20 07:12:22,012 DEBUG [(jenkins-hbase4.apache.org,37415,1689837019114)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37415-0x10181911f0f0000, quorum=127.0.0.1:58010, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44777,1689837020621 2023-07-20 07:12:22,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44777,1689837020621 2023-07-20 07:12:22,013 DEBUG [(jenkins-hbase4.apache.org,37415,1689837019114)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37415-0x10181911f0f0000, quorum=127.0.0.1:58010, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45099,1689837020733 2023-07-20 07:12:22,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45099,1689837020733 2023-07-20 07:12:22,016 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): master:37415-0x10181911f0f0000, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45099,1689837020733 2023-07-20 07:12:22,016 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): regionserver:44777-0x10181911f0f0001, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 07:12:22,016 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): regionserver:44955-0x10181911f0f0003, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 07:12:22,016 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): regionserver:44777-0x10181911f0f0001, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 07:12:22,016 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 07:12:22,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 07:12:22,016 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): master:37415-0x10181911f0f0000, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 07:12:22,016 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 07:12:22,016 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): master:37415-0x10181911f0f0000, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44777,1689837020621 2023-07-20 07:12:22,016 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithSkipTmp 2023-07-20 07:12:22,016 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): regionserver:45099-0x10181911f0f0002, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 07:12:22,016 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): master:37415-0x10181911f0f0000, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44955,1689837020792 2023-07-20 07:12:22,016 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => e9516f04c7d2974b21addb190acc6c0a, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,.mob,0.e9516f04c7d2974b21addb190acc6c0a.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 07:12:22,016 DEBUG [(jenkins-hbase4.apache.org,37415,1689837019114)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-20 07:12:22,016 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): regionserver:44955-0x10181911f0f0003, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 07:12:22,016 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 07:12:22,017 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-20 07:12:22,017 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): master:37415-0x10181911f0f0000, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 07:12:22,016 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 07:12:22,016 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): regionserver:45099-0x10181911f0f0002, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 07:12:22,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 07:12:22,018 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 07:12:22,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 07:12:22,018 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): master:37415-0x10181911f0f0000, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45099,1689837020733 2023-07-20 07:12:22,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 07:12:22,019 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): master:37415-0x10181911f0f0000, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 07:12:22,019 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): master:37415-0x10181911f0f0000, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44777,1689837020621 2023-07-20 07:12:22,019 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): master:37415-0x10181911f0f0000, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44955,1689837020792 2023-07-20 07:12:22,019 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): master:37415-0x10181911f0f0000, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 07:12:22,019 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): master:37415-0x10181911f0f0000, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 07:12:22,019 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 07:12:22,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 07:12:22,019 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 07:12:22,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 07:12:22,019 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-07-20 07:12:22,027 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 07:12:22,027 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 07:12:22,033 DEBUG [Listener at jenkins-hbase4.apache.org/33837] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-20 07:12:22,034 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-20 07:12:22,034 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-07-20 07:12:22,034 DEBUG [Listener at jenkins-hbase4.apache.org/33837] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-20 07:12:22,042 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/.hbase-snapshot/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 07:12:22,058 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed 2023-07-20 07:12:22,058 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 07:12:22,059 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 07:12:22,059 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp at 1689837141931Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithSkipTmp at 1689837142027 (+96 ms)Consolidate snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1689837142027Loading Region manifests for emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1689837142027Writing data manifest for emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1689837142030 (+3 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1689837142037 (+7 ms)Snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed at 1689837142058 (+21 ms) 2023-07-20 07:12:22,061 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=111, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-20 07:12:22,063 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=111, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED in 129 msec 2023-07-20 07:12:22,234 DEBUG [Listener at jenkins-hbase4.apache.org/33837] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-20 07:12:22,235 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-20 07:12:22,235 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-20 07:12:22,239 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44955] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithSkipTmp,1,1689837141265.337cbc3c1a07f8b7bf3b2f87c5ddc22a. with WAL disabled. Data may be lost in the event of a crash. 2023-07-20 07:12:22,243 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44777] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithSkipTmp,,1689837141265.3210cdacd31df68ae51177f956c734a8. with WAL disabled. Data may be lost in the event of a crash. 2023-07-20 07:12:22,245 DEBUG [Listener at jenkins-hbase4.apache.org/33837] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithSkipTmp 2023-07-20 07:12:22,245 DEBUG [Listener at jenkins-hbase4.apache.org/33837] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithSkipTmp,,1689837141265.3210cdacd31df68ae51177f956c734a8. 2023-07-20 07:12:22,246 INFO [Listener at jenkins-hbase4.apache.org/33837] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-20 07:12:22,259 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-20 07:12:22,259 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689837142259 (current time:1689837142259). 2023-07-20 07:12:22,259 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-20 07:12:22,259 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] zookeeper.ReadOnlyZKClient(139): Connect 0x000779b2 to 127.0.0.1:58010 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-20 07:12:22,268 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@c33160a, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-20 07:12:22,270 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-20 07:12:22,271 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:57504, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-20 07:12:22,272 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x000779b2 to 127.0.0.1:58010 2023-07-20 07:12:22,272 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-20 07:12:22,273 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] zookeeper.ReadOnlyZKClient(139): Connect 0x44527399 to 127.0.0.1:58010 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-20 07:12:22,289 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7fa35848, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-20 07:12:22,297 DEBUG [hconnection-0x6bb492f0-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-20 07:12:22,302 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:57508, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-20 07:12:22,310 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-20 07:12:22,314 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:37752, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-20 07:12:22,315 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x44527399 to 127.0.0.1:58010 2023-07-20 07:12:22,315 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-20 07:12:22,316 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-07-20 07:12:22,316 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-20 07:12:22,316 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-20 07:12:22,319 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] procedure2.ProcedureExecutor(1029): Stored pid=112, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-20 07:12:22,321 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=112, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-20 07:12:22,322 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=112, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE; timeout=600000, timestamp=1689837742322 2023-07-20 07:12:22,322 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp 2023-07-20 07:12:22,322 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-20 07:12:22,324 DEBUG [Listener at jenkins-hbase4.apache.org/33837] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-20 07:12:22,324 DEBUG [Listener at jenkins-hbase4.apache.org/33837] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-20 07:12:22,324 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=113, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-20 07:12:22,326 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=112, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-20 07:12:22,329 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=112, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE in 8 msec 2023-07-20 07:12:22,331 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=113, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-20 07:12:22,331 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=113, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED; timeout=600000, timestamp=1689837742331 2023-07-20 07:12:22,345 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 07:12:22,346 INFO [(jenkins-hbase4.apache.org,37415,1689837019114)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' 2023-07-20 07:12:22,346 DEBUG [(jenkins-hbase4.apache.org,37415,1689837019114)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-20 07:12:22,347 DEBUG [(jenkins-hbase4.apache.org,37415,1689837019114)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' 2023-07-20 07:12:22,347 DEBUG [(jenkins-hbase4.apache.org,37415,1689837019114)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithSkipTmp', kicking off acquire phase on members. 2023-07-20 07:12:22,348 DEBUG [(jenkins-hbase4.apache.org,37415,1689837019114)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37415-0x10181911f0f0000, quorum=127.0.0.1:58010, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 07:12:22,348 DEBUG [(jenkins-hbase4.apache.org,37415,1689837019114)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 07:12:22,350 DEBUG [(jenkins-hbase4.apache.org,37415,1689837019114)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44777,1689837020621 2023-07-20 07:12:22,350 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): regionserver:44777-0x10181911f0f0001, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 07:12:22,350 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): regionserver:45099-0x10181911f0f0002, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 07:12:22,350 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 07:12:22,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 07:12:22,350 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): regionserver:44955-0x10181911f0f0003, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 07:12:22,350 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 07:12:22,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 07:12:22,350 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 07:12:22,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 07:12:22,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 07:12:22,351 DEBUG [(jenkins-hbase4.apache.org,37415,1689837019114)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37415-0x10181911f0f0000, quorum=127.0.0.1:58010, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44777,1689837020621 2023-07-20 07:12:22,351 DEBUG [(jenkins-hbase4.apache.org,37415,1689837019114)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44955,1689837020792 2023-07-20 07:12:22,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 07:12:22,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 07:12:22,351 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44777-0x10181911f0f0001, quorum=127.0.0.1:58010, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 07:12:22,351 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44955-0x10181911f0f0003, quorum=127.0.0.1:58010, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 07:12:22,351 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45099-0x10181911f0f0002, quorum=127.0.0.1:58010, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 07:12:22,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-07-20 07:12:22,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 07:12:22,352 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-20 07:12:22,352 DEBUG [(jenkins-hbase4.apache.org,37415,1689837019114)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37415-0x10181911f0f0000, quorum=127.0.0.1:58010, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44955,1689837020792 2023-07-20 07:12:22,352 DEBUG [(jenkins-hbase4.apache.org,37415,1689837019114)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-20 07:12:22,352 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 07:12:22,352 DEBUG [member: 'jenkins-hbase4.apache.org,44777,1689837020621' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-20 07:12:22,352 DEBUG [member: 'jenkins-hbase4.apache.org,44777,1689837020621' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-20 07:12:22,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-07-20 07:12:22,354 DEBUG [member: 'jenkins-hbase4.apache.org,44777,1689837020621' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-20 07:12:22,354 DEBUG [member: 'jenkins-hbase4.apache.org,44777,1689837020621' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-20 07:12:22,354 DEBUG [member: 'jenkins-hbase4.apache.org,44777,1689837020621' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44777,1689837020621' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-20 07:12:22,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-07-20 07:12:22,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 07:12:22,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 07:12:22,354 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-20 07:12:22,354 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-20 07:12:22,355 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 07:12:22,355 DEBUG [member: 'jenkins-hbase4.apache.org,44955,1689837020792' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-20 07:12:22,355 DEBUG [member: 'jenkins-hbase4.apache.org,44955,1689837020792' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-20 07:12:22,356 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 07:12:22,358 DEBUG [member: 'jenkins-hbase4.apache.org,44955,1689837020792' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-20 07:12:22,358 DEBUG [member: 'jenkins-hbase4.apache.org,44777,1689837020621' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 07:12:22,358 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): master:37415-0x10181911f0f0000, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44777,1689837020621 2023-07-20 07:12:22,358 DEBUG [member: 'jenkins-hbase4.apache.org,44955,1689837020792' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-20 07:12:22,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44777,1689837020621 2023-07-20 07:12:22,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-20 07:12:22,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-20 07:12:22,358 DEBUG [member: 'jenkins-hbase4.apache.org,44955,1689837020792' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44955,1689837020792' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-20 07:12:22,358 DEBUG [member: 'jenkins-hbase4.apache.org,45099,1689837020733' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-20 07:12:22,358 DEBUG [member: 'jenkins-hbase4.apache.org,45099,1689837020733' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-20 07:12:22,358 DEBUG [member: 'jenkins-hbase4.apache.org,44777,1689837020621' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44777-0x10181911f0f0001, quorum=127.0.0.1:58010, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 07:12:22,358 DEBUG [member: 'jenkins-hbase4.apache.org,44777,1689837020621' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-20 07:12:22,360 DEBUG [member: 'jenkins-hbase4.apache.org,45099,1689837020733' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-20 07:12:22,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-20 07:12:22,360 DEBUG [member: 'jenkins-hbase4.apache.org,45099,1689837020733' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-20 07:12:22,360 DEBUG [member: 'jenkins-hbase4.apache.org,45099,1689837020733' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45099,1689837020733' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-20 07:12:22,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-20 07:12:22,361 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): master:37415-0x10181911f0f0000, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44955,1689837020792 2023-07-20 07:12:22,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 07:12:22,361 DEBUG [member: 'jenkins-hbase4.apache.org,44955,1689837020792' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 07:12:22,363 DEBUG [member: 'jenkins-hbase4.apache.org,45099,1689837020733' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 07:12:22,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44955,1689837020792 2023-07-20 07:12:22,364 DEBUG [member: 'jenkins-hbase4.apache.org,44955,1689837020792' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44955-0x10181911f0f0003, quorum=127.0.0.1:58010, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 07:12:22,364 DEBUG [member: 'jenkins-hbase4.apache.org,44955,1689837020792' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-20 07:12:22,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44777,1689837020621 2023-07-20 07:12:22,364 DEBUG [member: 'jenkins-hbase4.apache.org,45099,1689837020733' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45099-0x10181911f0f0002, quorum=127.0.0.1:58010, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 07:12:22,364 DEBUG [member: 'jenkins-hbase4.apache.org,45099,1689837020733' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-20 07:12:22,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45099,1689837020733 2023-07-20 07:12:22,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-20 07:12:22,364 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44777,1689837020621' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-07-20 07:12:22,365 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@488016c6[Count = 1] remaining members to acquire global barrier 2023-07-20 07:12:22,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44955,1689837020792 2023-07-20 07:12:22,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-20 07:12:22,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-20 07:12:22,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-20 07:12:22,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-20 07:12:22,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 07:12:22,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44955,1689837020792 2023-07-20 07:12:22,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44777,1689837020621 2023-07-20 07:12:22,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45099,1689837020733 2023-07-20 07:12:22,367 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-20 07:12:22,367 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44955,1689837020792' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-07-20 07:12:22,367 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@488016c6[Count = 0] remaining members to acquire global barrier 2023-07-20 07:12:22,367 DEBUG [(jenkins-hbase4.apache.org,37415,1689837019114)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'in-barrier' execution. 2023-07-20 07:12:22,367 DEBUG [(jenkins-hbase4.apache.org,37415,1689837019114)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 07:12:22,371 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): regionserver:44955-0x10181911f0f0003, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 07:12:22,372 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): regionserver:45099-0x10181911f0f0002, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 07:12:22,372 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 07:12:22,372 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 07:12:22,372 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 07:12:22,372 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): regionserver:44777-0x10181911f0f0001, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 07:12:22,372 DEBUG [member: 'jenkins-hbase4.apache.org,45099,1689837020733' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-20 07:12:22,372 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 07:12:22,372 DEBUG [member: 'jenkins-hbase4.apache.org,45099,1689837020733' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-20 07:12:22,372 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 07:12:22,372 DEBUG [member: 'jenkins-hbase4.apache.org,45099,1689837020733' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,45099,1689837020733' in zk 2023-07-20 07:12:22,372 DEBUG [member: 'jenkins-hbase4.apache.org,44955,1689837020792' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-20 07:12:22,372 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 07:12:22,372 DEBUG [member: 'jenkins-hbase4.apache.org,44777,1689837020621' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-20 07:12:22,372 DEBUG [member: 'jenkins-hbase4.apache.org,44955,1689837020792' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-20 07:12:22,372 DEBUG [member: 'jenkins-hbase4.apache.org,44955,1689837020792' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-20 07:12:22,372 DEBUG [member: 'jenkins-hbase4.apache.org,44777,1689837020621' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-20 07:12:22,372 DEBUG [member: 'jenkins-hbase4.apache.org,44777,1689837020621' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-20 07:12:22,372 DEBUG [rs(jenkins-hbase4.apache.org,44777,1689837020621)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1689837141265.3210cdacd31df68ae51177f956c734a8. 2023-07-20 07:12:22,372 DEBUG [rs(jenkins-hbase4.apache.org,44955,1689837020792)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1689837141265.337cbc3c1a07f8b7bf3b2f87c5ddc22a. 2023-07-20 07:12:22,372 DEBUG [rs(jenkins-hbase4.apache.org,44777,1689837020621)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1689837141265.3210cdacd31df68ae51177f956c734a8. started... 2023-07-20 07:12:22,373 DEBUG [rs(jenkins-hbase4.apache.org,44955,1689837020792)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1689837141265.337cbc3c1a07f8b7bf3b2f87c5ddc22a. started... 2023-07-20 07:12:22,373 INFO [rs(jenkins-hbase4.apache.org,44777,1689837020621)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 3210cdacd31df68ae51177f956c734a8 1/1 column families, dataSize=199 B heapSize=688 B 2023-07-20 07:12:22,373 INFO [rs(jenkins-hbase4.apache.org,44955,1689837020792)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 337cbc3c1a07f8b7bf3b2f87c5ddc22a 1/1 column families, dataSize=3.06 KB heapSize=6.86 KB 2023-07-20 07:12:22,377 DEBUG [(jenkins-hbase4.apache.org,37415,1689837019114)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37415-0x10181911f0f0000, quorum=127.0.0.1:58010, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44777,1689837020621 2023-07-20 07:12:22,378 DEBUG [member: 'jenkins-hbase4.apache.org,45099,1689837020733' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-20 07:12:22,378 DEBUG [member: 'jenkins-hbase4.apache.org,45099,1689837020733' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-20 07:12:22,378 DEBUG [member: 'jenkins-hbase4.apache.org,45099,1689837020733' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-20 07:12:22,380 DEBUG [(jenkins-hbase4.apache.org,37415,1689837019114)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37415-0x10181911f0f0000, quorum=127.0.0.1:58010, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44955,1689837020792 2023-07-20 07:12:22,380 DEBUG [(jenkins-hbase4.apache.org,37415,1689837019114)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-20 07:12:22,424 DEBUG [Listener at jenkins-hbase4.apache.org/33837] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-20 07:12:22,425 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-20 07:12:22,425 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-07-20 07:12:22,426 DEBUG [Listener at jenkins-hbase4.apache.org/33837] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-20 07:12:22,445 INFO [rs(jenkins-hbase4.apache.org,44777,1689837020621)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202307205247f8b281d5445ea9030dc24cc1f40f to hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e202307205247f8b281d5445ea9030dc24cc1f40f 2023-07-20 07:12:22,518 INFO [rs(jenkins-hbase4.apache.org,44777,1689837020621)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=199, hasBloomFilter=true, into tmp file hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/data/default/testtb-testExportFileSystemStateWithSkipTmp/3210cdacd31df68ae51177f956c734a8/.tmp/cf/90276d578d374da3b3853fd7e46a1d9a 2023-07-20 07:12:22,519 INFO [rs(jenkins-hbase4.apache.org,44955,1689837020792)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230720d06e3f17575a4fdaa15f70ccbccd7dd3 to hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b20230720d06e3f17575a4fdaa15f70ccbccd7dd3 2023-07-20 07:12:22,525 DEBUG [rs(jenkins-hbase4.apache.org,44777,1689837020621)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/data/default/testtb-testExportFileSystemStateWithSkipTmp/3210cdacd31df68ae51177f956c734a8/.tmp/cf/90276d578d374da3b3853fd7e46a1d9a as hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/data/default/testtb-testExportFileSystemStateWithSkipTmp/3210cdacd31df68ae51177f956c734a8/cf/90276d578d374da3b3853fd7e46a1d9a 2023-07-20 07:12:22,533 INFO [rs(jenkins-hbase4.apache.org,44777,1689837020621)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/data/default/testtb-testExportFileSystemStateWithSkipTmp/3210cdacd31df68ae51177f956c734a8/cf/90276d578d374da3b3853fd7e46a1d9a, entries=3, sequenceid=6, filesize=5.4 K 2023-07-20 07:12:22,535 INFO [rs(jenkins-hbase4.apache.org,44777,1689837020621)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~199 B/199, heapSize ~672 B/672, currentSize=0 B/0 for 3210cdacd31df68ae51177f956c734a8 in 162ms, sequenceid=6, compaction requested=false 2023-07-20 07:12:22,535 DEBUG [rs(jenkins-hbase4.apache.org,44777,1689837020621)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithSkipTmp' 2023-07-20 07:12:22,536 DEBUG [rs(jenkins-hbase4.apache.org,44777,1689837020621)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 3210cdacd31df68ae51177f956c734a8: 2023-07-20 07:12:22,536 DEBUG [rs(jenkins-hbase4.apache.org,44777,1689837020621)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,,1689837141265.3210cdacd31df68ae51177f956c734a8.' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 07:12:22,536 DEBUG [rs(jenkins-hbase4.apache.org,44777,1689837020621)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-20 07:12:22,536 DEBUG [rs(jenkins-hbase4.apache.org,44777,1689837020621)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/data/default/testtb-testExportFileSystemStateWithSkipTmp/3210cdacd31df68ae51177f956c734a8/cf/90276d578d374da3b3853fd7e46a1d9a] hfiles 2023-07-20 07:12:22,536 DEBUG [rs(jenkins-hbase4.apache.org,44777,1689837020621)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/data/default/testtb-testExportFileSystemStateWithSkipTmp/3210cdacd31df68ae51177f956c734a8/cf/90276d578d374da3b3853fd7e46a1d9a for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 07:12:22,540 INFO [rs(jenkins-hbase4.apache.org,44955,1689837020792)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/data/default/testtb-testExportFileSystemStateWithSkipTmp/337cbc3c1a07f8b7bf3b2f87c5ddc22a/.tmp/cf/1ee6f41014ce4f46acc11dc216ee36c9 2023-07-20 07:12:22,546 DEBUG [rs(jenkins-hbase4.apache.org,44955,1689837020792)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/data/default/testtb-testExportFileSystemStateWithSkipTmp/337cbc3c1a07f8b7bf3b2f87c5ddc22a/.tmp/cf/1ee6f41014ce4f46acc11dc216ee36c9 as hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/data/default/testtb-testExportFileSystemStateWithSkipTmp/337cbc3c1a07f8b7bf3b2f87c5ddc22a/cf/1ee6f41014ce4f46acc11dc216ee36c9 2023-07-20 07:12:22,556 INFO [rs(jenkins-hbase4.apache.org,44955,1689837020792)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/data/default/testtb-testExportFileSystemStateWithSkipTmp/337cbc3c1a07f8b7bf3b2f87c5ddc22a/cf/1ee6f41014ce4f46acc11dc216ee36c9, entries=47, sequenceid=6, filesize=13.4 K 2023-07-20 07:12:22,567 INFO [rs(jenkins-hbase4.apache.org,44955,1689837020792)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.06 KB/3137, heapSize ~6.84 KB/7008, currentSize=0 B/0 for 337cbc3c1a07f8b7bf3b2f87c5ddc22a in 194ms, sequenceid=6, compaction requested=false 2023-07-20 07:12:22,589 DEBUG [rs(jenkins-hbase4.apache.org,44955,1689837020792)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 337cbc3c1a07f8b7bf3b2f87c5ddc22a: 2023-07-20 07:12:22,592 DEBUG [rs(jenkins-hbase4.apache.org,44955,1689837020792)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,1,1689837141265.337cbc3c1a07f8b7bf3b2f87c5ddc22a.' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 07:12:22,592 DEBUG [rs(jenkins-hbase4.apache.org,44955,1689837020792)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-20 07:12:22,592 DEBUG [rs(jenkins-hbase4.apache.org,44955,1689837020792)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/data/default/testtb-testExportFileSystemStateWithSkipTmp/337cbc3c1a07f8b7bf3b2f87c5ddc22a/cf/1ee6f41014ce4f46acc11dc216ee36c9] hfiles 2023-07-20 07:12:22,592 DEBUG [rs(jenkins-hbase4.apache.org,44955,1689837020792)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/data/default/testtb-testExportFileSystemStateWithSkipTmp/337cbc3c1a07f8b7bf3b2f87c5ddc22a/cf/1ee6f41014ce4f46acc11dc216ee36c9 for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 07:12:22,607 DEBUG [rs(jenkins-hbase4.apache.org,44777,1689837020621)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1689837141265.3210cdacd31df68ae51177f956c734a8. completed. 2023-07-20 07:12:22,607 DEBUG [rs(jenkins-hbase4.apache.org,44777,1689837020621)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1689837141265.3210cdacd31df68ae51177f956c734a8. 2023-07-20 07:12:22,607 DEBUG [member: 'jenkins-hbase4.apache.org,44777,1689837020621' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-20 07:12:22,607 DEBUG [member: 'jenkins-hbase4.apache.org,44777,1689837020621' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-20 07:12:22,607 DEBUG [member: 'jenkins-hbase4.apache.org,44777,1689837020621' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,44777,1689837020621 2023-07-20 07:12:22,607 DEBUG [member: 'jenkins-hbase4.apache.org,44777,1689837020621' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-20 07:12:22,607 DEBUG [member: 'jenkins-hbase4.apache.org,44777,1689837020621' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,44777,1689837020621' in zk 2023-07-20 07:12:22,609 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): master:37415-0x10181911f0f0000, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44777,1689837020621 2023-07-20 07:12:22,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44777,1689837020621 2023-07-20 07:12:22,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-20 07:12:22,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-20 07:12:22,609 DEBUG [member: 'jenkins-hbase4.apache.org,44777,1689837020621' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-20 07:12:22,609 DEBUG [member: 'jenkins-hbase4.apache.org,44777,1689837020621' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-20 07:12:22,610 DEBUG [member: 'jenkins-hbase4.apache.org,44777,1689837020621' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-20 07:12:22,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-20 07:12:22,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-20 07:12:22,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 07:12:22,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44955,1689837020792 2023-07-20 07:12:22,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44777,1689837020621 2023-07-20 07:12:22,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45099,1689837020733 2023-07-20 07:12:22,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-20 07:12:22,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 07:12:22,626 DEBUG [Listener at jenkins-hbase4.apache.org/33837] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-20 07:12:22,627 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44777,1689837020621 2023-07-20 07:12:22,627 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45099,1689837020733 2023-07-20 07:12:22,627 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-20 07:12:22,627 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-07-20 07:12:22,628 DEBUG [Listener at jenkins-hbase4.apache.org/33837] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-20 07:12:22,628 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,44777,1689837020621': 2023-07-20 07:12:22,628 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44777,1689837020621' released barrier for procedure'snaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 1 more 2023-07-20 07:12:22,669 DEBUG [rs(jenkins-hbase4.apache.org,44955,1689837020792)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1689837141265.337cbc3c1a07f8b7bf3b2f87c5ddc22a. completed. 2023-07-20 07:12:22,669 DEBUG [rs(jenkins-hbase4.apache.org,44955,1689837020792)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1689837141265.337cbc3c1a07f8b7bf3b2f87c5ddc22a. 2023-07-20 07:12:22,669 DEBUG [member: 'jenkins-hbase4.apache.org,44955,1689837020792' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-20 07:12:22,669 DEBUG [member: 'jenkins-hbase4.apache.org,44955,1689837020792' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-20 07:12:22,670 DEBUG [member: 'jenkins-hbase4.apache.org,44955,1689837020792' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,44955,1689837020792 2023-07-20 07:12:22,670 DEBUG [member: 'jenkins-hbase4.apache.org,44955,1689837020792' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-20 07:12:22,670 DEBUG [member: 'jenkins-hbase4.apache.org,44955,1689837020792' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,44955,1689837020792' in zk 2023-07-20 07:12:22,672 DEBUG [member: 'jenkins-hbase4.apache.org,44955,1689837020792' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-20 07:12:22,672 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): master:37415-0x10181911f0f0000, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44955,1689837020792 2023-07-20 07:12:22,672 DEBUG [member: 'jenkins-hbase4.apache.org,44955,1689837020792' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-20 07:12:22,672 DEBUG [member: 'jenkins-hbase4.apache.org,44955,1689837020792' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-20 07:12:22,672 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44955,1689837020792 2023-07-20 07:12:22,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-20 07:12:22,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-20 07:12:22,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-20 07:12:22,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-20 07:12:22,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 07:12:22,677 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44955,1689837020792 2023-07-20 07:12:22,678 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44777,1689837020621 2023-07-20 07:12:22,678 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45099,1689837020733 2023-07-20 07:12:22,678 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-20 07:12:22,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 07:12:22,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44955,1689837020792 2023-07-20 07:12:22,680 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44777,1689837020621 2023-07-20 07:12:22,680 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45099,1689837020733 2023-07-20 07:12:22,681 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,44955,1689837020792': 2023-07-20 07:12:22,681 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44955,1689837020792' released barrier for procedure'snaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 0 more 2023-07-20 07:12:22,681 INFO [(jenkins-hbase4.apache.org,37415,1689837019114)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' execution completed 2023-07-20 07:12:22,681 DEBUG [(jenkins-hbase4.apache.org,37415,1689837019114)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-20 07:12:22,681 DEBUG [(jenkins-hbase4.apache.org,37415,1689837019114)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-20 07:12:22,681 DEBUG [(jenkins-hbase4.apache.org,37415,1689837019114)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 07:12:22,681 INFO [(jenkins-hbase4.apache.org,37415,1689837019114)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithSkipTmpincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-20 07:12:22,684 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): regionserver:45099-0x10181911f0f0002, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 07:12:22,684 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): master:37415-0x10181911f0f0000, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 07:12:22,684 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): regionserver:44777-0x10181911f0f0001, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 07:12:22,684 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 07:12:22,684 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): regionserver:44955-0x10181911f0f0003, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 07:12:22,684 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 07:12:22,684 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): regionserver:44777-0x10181911f0f0001, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 07:12:22,684 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 07:12:22,684 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 07:12:22,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-20 07:12:22,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-20 07:12:22,684 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): regionserver:45099-0x10181911f0f0002, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 07:12:22,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 07:12:22,684 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): regionserver:44955-0x10181911f0f0003, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 07:12:22,684 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 07:12:22,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 07:12:22,685 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 07:12:22,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-20 07:12:22,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 07:12:22,685 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 07:12:22,685 DEBUG [(jenkins-hbase4.apache.org,37415,1689837019114)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37415-0x10181911f0f0000, quorum=127.0.0.1:58010, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44955,1689837020792 2023-07-20 07:12:22,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 07:12:22,685 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 07:12:22,686 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 07:12:22,686 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 07:12:22,686 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 07:12:22,686 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 07:12:22,686 DEBUG [(jenkins-hbase4.apache.org,37415,1689837019114)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37415-0x10181911f0f0000, quorum=127.0.0.1:58010, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44777,1689837020621 2023-07-20 07:12:22,686 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 07:12:22,687 DEBUG [(jenkins-hbase4.apache.org,37415,1689837019114)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37415-0x10181911f0f0000, quorum=127.0.0.1:58010, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45099,1689837020733 2023-07-20 07:12:22,687 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-20 07:12:22,687 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 07:12:22,688 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44955,1689837020792 2023-07-20 07:12:22,688 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44777,1689837020621 2023-07-20 07:12:22,688 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45099,1689837020733 2023-07-20 07:12:22,689 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-20 07:12:22,689 DEBUG [(jenkins-hbase4.apache.org,37415,1689837019114)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37415-0x10181911f0f0000, quorum=127.0.0.1:58010, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44955,1689837020792 2023-07-20 07:12:22,689 DEBUG [(jenkins-hbase4.apache.org,37415,1689837019114)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37415-0x10181911f0f0000, quorum=127.0.0.1:58010, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44777,1689837020621 2023-07-20 07:12:22,689 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 07:12:22,689 DEBUG [(jenkins-hbase4.apache.org,37415,1689837019114)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37415-0x10181911f0f0000, quorum=127.0.0.1:58010, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45099,1689837020733 2023-07-20 07:12:22,689 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44955,1689837020792 2023-07-20 07:12:22,690 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44777,1689837020621 2023-07-20 07:12:22,690 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45099,1689837020733 2023-07-20 07:12:22,693 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): regionserver:44955-0x10181911f0f0003, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 07:12:22,693 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): regionserver:44955-0x10181911f0f0003, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 07:12:22,693 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 07:12:22,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 07:12:22,693 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): regionserver:44777-0x10181911f0f0001, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 07:12:22,693 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): regionserver:44777-0x10181911f0f0001, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 07:12:22,693 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): master:37415-0x10181911f0f0000, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45099,1689837020733 2023-07-20 07:12:22,693 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): master:37415-0x10181911f0f0000, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 07:12:22,693 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): master:37415-0x10181911f0f0000, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44777,1689837020621 2023-07-20 07:12:22,693 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): master:37415-0x10181911f0f0000, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44955,1689837020792 2023-07-20 07:12:22,693 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): master:37415-0x10181911f0f0000, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 07:12:22,693 DEBUG [(jenkins-hbase4.apache.org,37415,1689837019114)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-20 07:12:22,693 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): regionserver:45099-0x10181911f0f0002, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 07:12:22,693 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 07:12:22,693 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 07:12:22,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 07:12:22,693 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): regionserver:45099-0x10181911f0f0002, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 07:12:22,693 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): master:37415-0x10181911f0f0000, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45099,1689837020733 2023-07-20 07:12:22,693 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithSkipTmp 2023-07-20 07:12:22,694 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): master:37415-0x10181911f0f0000, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 07:12:22,694 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): master:37415-0x10181911f0f0000, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44777,1689837020621 2023-07-20 07:12:22,694 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => e9516f04c7d2974b21addb190acc6c0a, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,.mob,0.e9516f04c7d2974b21addb190acc6c0a.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 07:12:22,694 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-20 07:12:22,694 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): master:37415-0x10181911f0f0000, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44955,1689837020792 2023-07-20 07:12:22,694 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): master:37415-0x10181911f0f0000, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 07:12:22,694 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): master:37415-0x10181911f0f0000, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 07:12:22,696 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 07:12:22,696 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 07:12:22,696 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 07:12:22,696 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 07:12:22,696 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b20230720d06e3f17575a4fdaa15f70ccbccd7dd3, hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e202307205247f8b281d5445ea9030dc24cc1f40f] mob files 2023-07-20 07:12:22,696 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 07:12:22,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 07:12:22,696 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b20230720d06e3f17575a4fdaa15f70ccbccd7dd3 2023-07-20 07:12:22,696 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 07:12:22,697 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e202307205247f8b281d5445ea9030dc24cc1f40f 2023-07-20 07:12:22,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 07:12:22,768 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 07:12:22,769 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 07:12:22,850 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 07:12:22,928 DEBUG [Listener at jenkins-hbase4.apache.org/33837] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-20 07:12:22,929 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-20 07:12:22,929 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-07-20 07:12:22,929 DEBUG [Listener at jenkins-hbase4.apache.org/33837] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-07-20 07:12:22,943 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed 2023-07-20 07:12:22,943 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 07:12:22,943 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 07:12:22,943 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp at 1689837142322Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithSkipTmp at 1689837142768 (+446 ms)Consolidate snapshot: snaptb0-testExportFileSystemStateWithSkipTmp at 1689837142768Loading Region manifests for snaptb0-testExportFileSystemStateWithSkipTmp at 1689837142768Writing data manifest for snaptb0-testExportFileSystemStateWithSkipTmp at 1689837142796 (+28 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithSkipTmp at 1689837142827 (+31 ms)Snapshot snaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed at 1689837142943 (+116 ms) 2023-07-20 07:12:22,946 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=113, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-20 07:12:22,948 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=113, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED in 622 msec 2023-07-20 07:12:23,429 DEBUG [Listener at jenkins-hbase4.apache.org/33837] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-20 07:12:23,430 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-20 07:12:23,430 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-20 07:12:23,431 INFO [Listener at jenkins-hbase4.apache.org/33837] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/export-test/export-1689837143431 2023-07-20 07:12:23,431 INFO [Listener at jenkins-hbase4.apache.org/33837] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:39649, tgtDir=hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/export-test/export-1689837143431, rawTgtDir=hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/export-test/export-1689837143431, srcFsUri=hdfs://localhost:39649, srcDir=hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b 2023-07-20 07:12:23,461 DEBUG [Listener at jenkins-hbase4.apache.org/33837] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:39649, inputRoot=hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b 2023-07-20 07:12:23,461 DEBUG [Listener at jenkins-hbase4.apache.org/33837] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1343673036_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/export-test/export-1689837143431, skipTmp=true, initialOutputSnapshotDir=hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/export-test/export-1689837143431/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 07:12:23,462 INFO [Listener at jenkins-hbase4.apache.org/33837] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:39649, inputRoot=hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b, snapshotDir=hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp. 2023-07-20 07:12:23,471 INFO [Listener at jenkins-hbase4.apache.org/33837] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/export-test/export-1689837143431/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 07:12:23,906 DEBUG [Listener at jenkins-hbase4.apache.org/33837] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-20 07:12:23,907 DEBUG [Listener at jenkins-hbase4.apache.org/33837] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-20 07:12:23,907 DEBUG [Listener at jenkins-hbase4.apache.org/33837] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-20 07:12:23,908 DEBUG [Listener at jenkins-hbase4.apache.org/33837] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-20 07:12:23,908 DEBUG [Listener at jenkins-hbase4.apache.org/33837] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-20 07:12:23,908 DEBUG [Listener at jenkins-hbase4.apache.org/33837] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-20 07:12:23,909 DEBUG [Listener at jenkins-hbase4.apache.org/33837] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-20 07:12:24,001 DEBUG [Listener at jenkins-hbase4.apache.org/33837] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c07d5e8c-eba2-0ae8-aa3a-b7afa648e7e7/hadoop-9183195081238953187.jar 2023-07-20 07:12:24,002 DEBUG [Listener at jenkins-hbase4.apache.org/33837] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-20 07:12:24,002 DEBUG [Listener at jenkins-hbase4.apache.org/33837] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-20 07:12:24,003 DEBUG [Listener at jenkins-hbase4.apache.org/33837] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-20 07:12:24,003 DEBUG [Listener at jenkins-hbase4.apache.org/33837] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-20 07:12:24,004 DEBUG [Listener at jenkins-hbase4.apache.org/33837] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-20 07:12:24,004 DEBUG [Listener at jenkins-hbase4.apache.org/33837] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-20 07:12:24,004 DEBUG [Listener at jenkins-hbase4.apache.org/33837] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-20 07:12:24,005 DEBUG [Listener at jenkins-hbase4.apache.org/33837] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-20 07:12:24,005 DEBUG [Listener at jenkins-hbase4.apache.org/33837] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-20 07:12:24,005 DEBUG [Listener at jenkins-hbase4.apache.org/33837] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-20 07:12:24,006 DEBUG [Listener at jenkins-hbase4.apache.org/33837] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-20 07:12:24,006 DEBUG [Listener at jenkins-hbase4.apache.org/33837] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-20 07:12:24,007 DEBUG [Listener at jenkins-hbase4.apache.org/33837] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-20 07:12:24,007 DEBUG [Listener at jenkins-hbase4.apache.org/33837] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-20 07:12:24,007 DEBUG [Listener at jenkins-hbase4.apache.org/33837] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-20 07:12:24,008 DEBUG [Listener at jenkins-hbase4.apache.org/33837] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-20 07:12:24,008 DEBUG [Listener at jenkins-hbase4.apache.org/33837] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-20 07:12:24,009 DEBUG [Listener at jenkins-hbase4.apache.org/33837] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-20 07:12:24,009 DEBUG [Listener at jenkins-hbase4.apache.org/33837] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-20 07:12:24,010 DEBUG [Listener at jenkins-hbase4.apache.org/33837] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-20 07:12:24,010 DEBUG [Listener at jenkins-hbase4.apache.org/33837] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-20 07:12:24,010 DEBUG [Listener at jenkins-hbase4.apache.org/33837] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-20 07:12:24,011 DEBUG [Listener at jenkins-hbase4.apache.org/33837] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-20 07:12:25,131 WARN [Listener at jenkins-hbase4.apache.org/33837] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-20 07:12:25,134 INFO [Listener at jenkins-hbase4.apache.org/33837] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemStateWithSkipTmp' hfile list 2023-07-20 07:12:25,136 DEBUG [Listener at jenkins-hbase4.apache.org/33837] snapshot.ExportSnapshot(671): export split=0 size=31.5 K 2023-07-20 07:12:25,169 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689837028633_0006_000001 (auth:SIMPLE) 2023-07-20 07:12:25,660 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-20 07:12:25,660 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-20 07:12:26,049 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689837028633_0007_000001 (auth:SIMPLE) 2023-07-20 07:12:26,687 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-20 07:12:32,974 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689837028633_0007_000001 (auth:SIMPLE) 2023-07-20 07:12:35,359 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689837028633_0007_000001 (auth:SIMPLE) 2023-07-20 07:12:39,798 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689837028633_0007_000001 (auth:SIMPLE) 2023-07-20 07:12:41,836 INFO [Listener at jenkins-hbase4.apache.org/33837] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-20 07:12:41,836 INFO [Listener at jenkins-hbase4.apache.org/33837] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-20 07:12:41,873 INFO [Listener at jenkins-hbase4.apache.org/33837] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 07:12:41,874 INFO [Listener at jenkins-hbase4.apache.org/33837] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-20 07:12:41,874 INFO [Listener at jenkins-hbase4.apache.org/33837] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-20 07:12:41,874 DEBUG [Listener at jenkins-hbase4.apache.org/33837] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_759529442_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp at hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 07:12:41,875 DEBUG [Listener at jenkins-hbase4.apache.org/33837] snapshot.TestExportSnapshot(367): hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/.snapshotinfo 2023-07-20 07:12:41,875 DEBUG [Listener at jenkins-hbase4.apache.org/33837] snapshot.TestExportSnapshot(367): hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/data.manifest 2023-07-20 07:12:41,875 DEBUG [Listener at jenkins-hbase4.apache.org/33837] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_759529442_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/export-test/export-1689837143431/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp at hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/export-test/export-1689837143431/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 07:12:41,876 DEBUG [Listener at jenkins-hbase4.apache.org/33837] snapshot.TestExportSnapshot(367): hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/export-test/export-1689837143431/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/.snapshotinfo 2023-07-20 07:12:41,876 DEBUG [Listener at jenkins-hbase4.apache.org/33837] snapshot.TestExportSnapshot(367): hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/export-test/export-1689837143431/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/data.manifest 2023-07-20 07:12:41,886 INFO [Listener at jenkins-hbase4.apache.org/33837] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithSkipTmp 2023-07-20 07:12:41,887 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemStateWithSkipTmp 2023-07-20 07:12:41,888 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] procedure2.ProcedureExecutor(1029): Stored pid=114, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-20 07:12:41,892 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689837161892"}]},"ts":"1689837161892"} 2023-07-20 07:12:41,894 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=DISABLING in hbase:meta 2023-07-20 07:12:41,894 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-07-20 07:12:41,896 INFO [PEWorker-4] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithSkipTmp to state=DISABLING 2023-07-20 07:12:41,896 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=115, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=3210cdacd31df68ae51177f956c734a8, UNASSIGN}, {pid=116, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=337cbc3c1a07f8b7bf3b2f87c5ddc22a, UNASSIGN}] 2023-07-20 07:12:41,897 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=115, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=3210cdacd31df68ae51177f956c734a8, UNASSIGN 2023-07-20 07:12:41,899 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=116, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=337cbc3c1a07f8b7bf3b2f87c5ddc22a, UNASSIGN 2023-07-20 07:12:41,900 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=116 updating hbase:meta row=337cbc3c1a07f8b7bf3b2f87c5ddc22a, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,44955,1689837020792 2023-07-20 07:12:41,900 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689837141265.337cbc3c1a07f8b7bf3b2f87c5ddc22a.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689837161900"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689837161900"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689837161900"}]},"ts":"1689837161900"} 2023-07-20 07:12:41,901 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=117, ppid=116, state=RUNNABLE; CloseRegionProcedure 337cbc3c1a07f8b7bf3b2f87c5ddc22a, server=jenkins-hbase4.apache.org,44955,1689837020792}] 2023-07-20 07:12:41,903 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=115 updating hbase:meta row=3210cdacd31df68ae51177f956c734a8, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,44777,1689837020621 2023-07-20 07:12:41,903 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689837141265.3210cdacd31df68ae51177f956c734a8.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689837161903"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689837161903"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689837161903"}]},"ts":"1689837161903"} 2023-07-20 07:12:41,905 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=118, ppid=115, state=RUNNABLE; CloseRegionProcedure 3210cdacd31df68ae51177f956c734a8, server=jenkins-hbase4.apache.org,44777,1689837020621}] 2023-07-20 07:12:41,996 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-07-20 07:12:42,053 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 337cbc3c1a07f8b7bf3b2f87c5ddc22a 2023-07-20 07:12:42,054 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 337cbc3c1a07f8b7bf3b2f87c5ddc22a, disabling compactions & flushes 2023-07-20 07:12:42,054 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,1,1689837141265.337cbc3c1a07f8b7bf3b2f87c5ddc22a. 2023-07-20 07:12:42,054 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1689837141265.337cbc3c1a07f8b7bf3b2f87c5ddc22a. 2023-07-20 07:12:42,054 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1689837141265.337cbc3c1a07f8b7bf3b2f87c5ddc22a. after waiting 0 ms 2023-07-20 07:12:42,054 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,1,1689837141265.337cbc3c1a07f8b7bf3b2f87c5ddc22a. 2023-07-20 07:12:42,060 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 3210cdacd31df68ae51177f956c734a8 2023-07-20 07:12:42,060 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 3210cdacd31df68ae51177f956c734a8, disabling compactions & flushes 2023-07-20 07:12:42,060 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,,1689837141265.3210cdacd31df68ae51177f956c734a8. 2023-07-20 07:12:42,060 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,,1689837141265.3210cdacd31df68ae51177f956c734a8. 2023-07-20 07:12:42,060 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,,1689837141265.3210cdacd31df68ae51177f956c734a8. after waiting 0 ms 2023-07-20 07:12:42,060 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,,1689837141265.3210cdacd31df68ae51177f956c734a8. 2023-07-20 07:12:42,076 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/data/default/testtb-testExportFileSystemStateWithSkipTmp/337cbc3c1a07f8b7bf3b2f87c5ddc22a/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-20 07:12:42,077 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/data/default/testtb-testExportFileSystemStateWithSkipTmp/3210cdacd31df68ae51177f956c734a8/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-20 07:12:42,077 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-20 07:12:42,078 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,1,1689837141265.337cbc3c1a07f8b7bf3b2f87c5ddc22a. 2023-07-20 07:12:42,078 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 337cbc3c1a07f8b7bf3b2f87c5ddc22a: 2023-07-20 07:12:42,078 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-20 07:12:42,080 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,,1689837141265.3210cdacd31df68ae51177f956c734a8. 2023-07-20 07:12:42,080 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 3210cdacd31df68ae51177f956c734a8: 2023-07-20 07:12:42,083 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 337cbc3c1a07f8b7bf3b2f87c5ddc22a 2023-07-20 07:12:42,084 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=116 updating hbase:meta row=337cbc3c1a07f8b7bf3b2f87c5ddc22a, regionState=CLOSED 2023-07-20 07:12:42,084 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 3210cdacd31df68ae51177f956c734a8 2023-07-20 07:12:42,084 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689837141265.337cbc3c1a07f8b7bf3b2f87c5ddc22a.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689837162084"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689837162084"}]},"ts":"1689837162084"} 2023-07-20 07:12:42,085 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=115 updating hbase:meta row=3210cdacd31df68ae51177f956c734a8, regionState=CLOSED 2023-07-20 07:12:42,085 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689837141265.3210cdacd31df68ae51177f956c734a8.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689837162085"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689837162085"}]},"ts":"1689837162085"} 2023-07-20 07:12:42,088 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=117, resume processing ppid=116 2023-07-20 07:12:42,088 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=117, ppid=116, state=SUCCESS; CloseRegionProcedure 337cbc3c1a07f8b7bf3b2f87c5ddc22a, server=jenkins-hbase4.apache.org,44955,1689837020792 in 185 msec 2023-07-20 07:12:42,088 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=118, resume processing ppid=115 2023-07-20 07:12:42,089 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=118, ppid=115, state=SUCCESS; CloseRegionProcedure 3210cdacd31df68ae51177f956c734a8, server=jenkins-hbase4.apache.org,44777,1689837020621 in 182 msec 2023-07-20 07:12:42,089 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=116, ppid=114, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=337cbc3c1a07f8b7bf3b2f87c5ddc22a, UNASSIGN in 192 msec 2023-07-20 07:12:42,090 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=115, resume processing ppid=114 2023-07-20 07:12:42,090 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=115, ppid=114, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=3210cdacd31df68ae51177f956c734a8, UNASSIGN in 193 msec 2023-07-20 07:12:42,091 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689837162090"}]},"ts":"1689837162090"} 2023-07-20 07:12:42,092 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=DISABLED in hbase:meta 2023-07-20 07:12:42,093 INFO [PEWorker-3] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithSkipTmp to state=DISABLED 2023-07-20 07:12:42,095 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=114, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 207 msec 2023-07-20 07:12:42,197 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-07-20 07:12:42,197 INFO [Listener at jenkins-hbase4.apache.org/33837] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 114 completed 2023-07-20 07:12:42,198 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemStateWithSkipTmp 2023-07-20 07:12:42,199 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] procedure2.ProcedureExecutor(1029): Stored pid=119, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-20 07:12:42,201 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=119, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-20 07:12:42,202 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithSkipTmp 2023-07-20 07:12:42,202 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=119, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-20 07:12:42,203 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=44955] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithSkipTmp 2023-07-20 07:12:42,208 DEBUG [HFileArchiver-22] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/3210cdacd31df68ae51177f956c734a8 2023-07-20 07:12:42,208 DEBUG [HFileArchiver-23] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/337cbc3c1a07f8b7bf3b2f87c5ddc22a 2023-07-20 07:12:42,210 DEBUG [HFileArchiver-23] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/337cbc3c1a07f8b7bf3b2f87c5ddc22a/cf, FileablePath, hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/337cbc3c1a07f8b7bf3b2f87c5ddc22a/recovered.edits] 2023-07-20 07:12:42,211 DEBUG [HFileArchiver-22] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/3210cdacd31df68ae51177f956c734a8/cf, FileablePath, hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/3210cdacd31df68ae51177f956c734a8/recovered.edits] 2023-07-20 07:12:42,211 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): regionserver:44955-0x10181911f0f0003, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-20 07:12:42,211 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): regionserver:45099-0x10181911f0f0002, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-20 07:12:42,211 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): regionserver:44777-0x10181911f0f0001, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-20 07:12:42,211 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): master:37415-0x10181911f0f0000, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-20 07:12:42,212 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-07-20 07:12:42,213 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): regionserver:44777-0x10181911f0f0001, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-20 07:12:42,213 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): regionserver:45099-0x10181911f0f0002, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-20 07:12:42,213 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): regionserver:44955-0x10181911f0f0003, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-20 07:12:42,213 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data null 2023-07-20 07:12:42,213 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data null 2023-07-20 07:12:42,213 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-20 07:12:42,213 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data null 2023-07-20 07:12:42,214 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-20 07:12:42,213 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-20 07:12:42,213 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): master:37415-0x10181911f0f0000, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-20 07:12:42,213 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): regionserver:44955-0x10181911f0f0003, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-20 07:12:42,214 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] master.MasterRpcServices(1230): Checking to see if procedure is done pid=119 2023-07-20 07:12:42,218 DEBUG [HFileArchiver-23] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/337cbc3c1a07f8b7bf3b2f87c5ddc22a/cf/1ee6f41014ce4f46acc11dc216ee36c9 to hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/337cbc3c1a07f8b7bf3b2f87c5ddc22a/cf/1ee6f41014ce4f46acc11dc216ee36c9 2023-07-20 07:12:42,220 DEBUG [HFileArchiver-22] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/3210cdacd31df68ae51177f956c734a8/cf/90276d578d374da3b3853fd7e46a1d9a to hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/3210cdacd31df68ae51177f956c734a8/cf/90276d578d374da3b3853fd7e46a1d9a 2023-07-20 07:12:42,222 DEBUG [HFileArchiver-23] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/337cbc3c1a07f8b7bf3b2f87c5ddc22a/recovered.edits/9.seqid to hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/337cbc3c1a07f8b7bf3b2f87c5ddc22a/recovered.edits/9.seqid 2023-07-20 07:12:42,223 DEBUG [HFileArchiver-23] backup.HFileArchiver(596): Deleted hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/337cbc3c1a07f8b7bf3b2f87c5ddc22a 2023-07-20 07:12:42,225 DEBUG [HFileArchiver-22] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/3210cdacd31df68ae51177f956c734a8/recovered.edits/9.seqid to hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/3210cdacd31df68ae51177f956c734a8/recovered.edits/9.seqid 2023-07-20 07:12:42,225 DEBUG [HFileArchiver-22] backup.HFileArchiver(596): Deleted hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/3210cdacd31df68ae51177f956c734a8 2023-07-20 07:12:42,225 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithSkipTmp regions 2023-07-20 07:12:42,226 DEBUG [PEWorker-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a 2023-07-20 07:12:42,227 DEBUG [PEWorker-2] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf] 2023-07-20 07:12:42,230 DEBUG [PEWorker-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b20230720d06e3f17575a4fdaa15f70ccbccd7dd3 to hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b20230720d06e3f17575a4fdaa15f70ccbccd7dd3 2023-07-20 07:12:42,231 DEBUG [PEWorker-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e202307205247f8b281d5445ea9030dc24cc1f40f to hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e202307205247f8b281d5445ea9030dc24cc1f40f 2023-07-20 07:12:42,232 DEBUG [PEWorker-2] backup.HFileArchiver(596): Deleted hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a 2023-07-20 07:12:42,234 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=119, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-20 07:12:42,238 WARN [PEWorker-2] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemStateWithSkipTmp from hbase:meta 2023-07-20 07:12:42,240 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithSkipTmp' descriptor. 2023-07-20 07:12:42,242 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=119, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-20 07:12:42,242 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithSkipTmp' from region states. 2023-07-20 07:12:42,242 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689837141265.3210cdacd31df68ae51177f956c734a8.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689837162242"}]},"ts":"9223372036854775807"} 2023-07-20 07:12:42,242 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689837141265.337cbc3c1a07f8b7bf3b2f87c5ddc22a.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689837162242"}]},"ts":"9223372036854775807"} 2023-07-20 07:12:42,244 INFO [PEWorker-2] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-20 07:12:42,244 DEBUG [PEWorker-2] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 3210cdacd31df68ae51177f956c734a8, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1689837141265.3210cdacd31df68ae51177f956c734a8.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 337cbc3c1a07f8b7bf3b2f87c5ddc22a, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1689837141265.337cbc3c1a07f8b7bf3b2f87c5ddc22a.', STARTKEY => '1', ENDKEY => ''}] 2023-07-20 07:12:42,244 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithSkipTmp' as deleted. 2023-07-20 07:12:42,244 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689837162244"}]},"ts":"9223372036854775807"} 2023-07-20 07:12:42,248 INFO [PEWorker-2] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithSkipTmp state from META 2023-07-20 07:12:42,251 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(130): Finished pid=119, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-20 07:12:42,252 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=119, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 53 msec 2023-07-20 07:12:42,315 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] master.MasterRpcServices(1230): Checking to see if procedure is done pid=119 2023-07-20 07:12:42,316 INFO [Listener at jenkins-hbase4.apache.org/33837] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 119 completed 2023-07-20 07:12:42,322 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportFileSystemStateWithSkipTmp" 2023-07-20 07:12:42,324 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 07:12:42,325 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemStateWithSkipTmp" 2023-07-20 07:12:42,327 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37415] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 07:12:42,354 INFO [Listener at jenkins-hbase4.apache.org/33837] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithSkipTmp Thread=764 (was 761) Potentially hanging thread: IPC Client (309353702) connection to jenkins-hbase4.apache.org/172.31.14.131:44203 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x7a39bf3a-shared-pool-41 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-22 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_514598207_1 at /127.0.0.1:36726 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-23 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #11 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x7a39bf3a-shared-pool-40 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x7a39bf3a-shared-pool-43 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_514598207_1 at /127.0.0.1:38694 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_759529442_17 at /127.0.0.1:35032 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #12 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ContainersLauncher #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_759529442_17 at /127.0.0.1:50068 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LogDeleter #3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1088) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_759529442_17 at /127.0.0.1:59078 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-5434 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: hconnection-0x7a39bf3a-shared-pool-42 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=901 (was 906), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=641 (was 604) - SystemLoadAverage LEAK? -, ProcessCount=181 (was 184), AvailableMemoryMB=1555 (was 1209) - AvailableMemoryMB LEAK? - 2023-07-20 07:12:42,354 WARN [Listener at jenkins-hbase4.apache.org/33837] hbase.ResourceChecker(130): Thread=764 is superior to 500 2023-07-20 07:12:42,354 INFO [Listener at jenkins-hbase4.apache.org/33837] hbase.HBaseTestingUtility(2762): Stopping mini mapreduce cluster... 2023-07-20 07:12:42,367 INFO [Listener at jenkins-hbase4.apache.org/33837] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-07-20 07:12:46,027 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689837028633_0007_000001 (auth:SIMPLE) 2023-07-20 07:12:47,663 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-20 07:12:56,497 INFO [Listener at jenkins-hbase4.apache.org/33837] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-07-20 07:13:10,620 ERROR [Thread[Thread-409,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-07-20 07:13:10,621 INFO [Listener at jenkins-hbase4.apache.org/33837] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-07-20 07:13:10,734 WARN [ApplicationMaster Launcher] amlauncher.ApplicationMasterLauncher$LauncherThread(122): org.apache.hadoop.yarn.server.resourcemanager.amlauncher.ApplicationMasterLauncher$LauncherThread interrupted. Returning. 2023-07-20 07:13:10,744 ERROR [SchedulerEventDispatcher:Event Processor] event.EventDispatcher$EventProcessor(61): Returning, interrupted : java.lang.InterruptedException 2023-07-20 07:13:10,745 ERROR [Thread[Thread-419,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-07-20 07:13:10,764 INFO [Listener at jenkins-hbase4.apache.org/33837] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-07-20 07:13:10,869 ERROR [Thread[Thread-384,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-07-20 07:13:10,869 INFO [Listener at jenkins-hbase4.apache.org/33837] hbase.HBaseTestingUtility(2765): Mini mapreduce cluster stopped 2023-07-20 07:13:10,869 INFO [Listener at jenkins-hbase4.apache.org/33837] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-07-20 07:13:10,869 INFO [Listener at jenkins-hbase4.apache.org/33837] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-07-20 07:13:10,869 DEBUG [Listener at jenkins-hbase4.apache.org/33837] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x37ed2880 to 127.0.0.1:58010 2023-07-20 07:13:10,869 DEBUG [Listener at jenkins-hbase4.apache.org/33837] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-20 07:13:10,870 DEBUG [Listener at jenkins-hbase4.apache.org/33837] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-07-20 07:13:10,870 DEBUG [Listener at jenkins-hbase4.apache.org/33837] util.JVMClusterUtil(257): Found active master hash=1157648882, stopped=false 2023-07-20 07:13:10,870 DEBUG [Listener at jenkins-hbase4.apache.org/33837] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-20 07:13:10,870 DEBUG [Listener at jenkins-hbase4.apache.org/33837] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver 2023-07-20 07:13:10,871 INFO [Listener at jenkins-hbase4.apache.org/33837] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase4.apache.org,37415,1689837019114 2023-07-20 07:13:10,872 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): regionserver:45099-0x10181911f0f0002, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-20 07:13:10,872 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): master:37415-0x10181911f0f0000, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-20 07:13:10,872 INFO [Listener at jenkins-hbase4.apache.org/33837] procedure2.ProcedureExecutor(629): Stopping 2023-07-20 07:13:10,872 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): regionserver:44955-0x10181911f0f0003, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-20 07:13:10,872 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): regionserver:44777-0x10181911f0f0001, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-20 07:13:10,872 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45099-0x10181911f0f0002, quorum=127.0.0.1:58010, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-20 07:13:10,873 DEBUG [Listener at jenkins-hbase4.apache.org/33837] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x69240ce0 to 127.0.0.1:58010 2023-07-20 07:13:10,872 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): master:37415-0x10181911f0f0000, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-20 07:13:10,873 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:37415-0x10181911f0f0000, quorum=127.0.0.1:58010, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-20 07:13:10,873 DEBUG [Listener at jenkins-hbase4.apache.org/33837] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-20 07:13:10,873 INFO [Listener at jenkins-hbase4.apache.org/33837] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,44777,1689837020621' ***** 2023-07-20 07:13:10,873 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44777-0x10181911f0f0001, quorum=127.0.0.1:58010, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-20 07:13:10,874 DEBUG [Listener at jenkins-hbase4.apache.org/33837] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-20 07:13:10,874 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44955-0x10181911f0f0003, quorum=127.0.0.1:58010, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-20 07:13:10,874 INFO [Listener at jenkins-hbase4.apache.org/33837] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-07-20 07:13:10,874 INFO [Listener at jenkins-hbase4.apache.org/33837] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,45099,1689837020733' ***** 2023-07-20 07:13:10,874 DEBUG [Listener at jenkins-hbase4.apache.org/33837] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-20 07:13:10,874 INFO [Listener at jenkins-hbase4.apache.org/33837] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-07-20 07:13:10,874 INFO [RS:0;jenkins-hbase4:44777] regionserver.HeapMemoryManager(220): Stopping 2023-07-20 07:13:10,874 INFO [Listener at jenkins-hbase4.apache.org/33837] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,44955,1689837020792' ***** 2023-07-20 07:13:10,874 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-07-20 07:13:10,874 DEBUG [Listener at jenkins-hbase4.apache.org/33837] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-20 07:13:10,874 INFO [RS:0;jenkins-hbase4:44777] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-07-20 07:13:10,874 INFO [RS:1;jenkins-hbase4:45099] regionserver.HeapMemoryManager(220): Stopping 2023-07-20 07:13:10,875 INFO [RS:0;jenkins-hbase4:44777] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-07-20 07:13:10,875 INFO [RS:1;jenkins-hbase4:45099] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-07-20 07:13:10,875 INFO [RS:1;jenkins-hbase4:45099] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-07-20 07:13:10,875 INFO [RS:1;jenkins-hbase4:45099] regionserver.HRegionServer(3305): Received CLOSE for 37013e44b8b1510f4bef8010666ea4e1 2023-07-20 07:13:10,875 INFO [RS:1;jenkins-hbase4:45099] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,45099,1689837020733 2023-07-20 07:13:10,875 DEBUG [RS:1;jenkins-hbase4:45099] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x29ed6361 to 127.0.0.1:58010 2023-07-20 07:13:10,875 DEBUG [RS:1;jenkins-hbase4:45099] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-20 07:13:10,875 INFO [Listener at jenkins-hbase4.apache.org/33837] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-07-20 07:13:10,876 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 37013e44b8b1510f4bef8010666ea4e1, disabling compactions & flushes 2023-07-20 07:13:10,878 INFO [RS:2;jenkins-hbase4:44955] regionserver.HeapMemoryManager(220): Stopping 2023-07-20 07:13:10,878 INFO [RS:2;jenkins-hbase4:44955] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-07-20 07:13:10,878 INFO [RS:2;jenkins-hbase4:44955] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-07-20 07:13:10,878 INFO [RS:2;jenkins-hbase4:44955] regionserver.HRegionServer(3305): Received CLOSE for a99cc01e32f8591c1e330231bf41e07d 2023-07-20 07:13:10,879 INFO [RS:2;jenkins-hbase4:44955] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,44955,1689837020792 2023-07-20 07:13:10,879 DEBUG [RS:2;jenkins-hbase4:44955] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x375ddc70 to 127.0.0.1:58010 2023-07-20 07:13:10,879 DEBUG [RS:2;jenkins-hbase4:44955] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-20 07:13:10,875 INFO [RS:0;jenkins-hbase4:44777] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,44777,1689837020621 2023-07-20 07:13:10,875 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-07-20 07:13:10,879 DEBUG [RS:0;jenkins-hbase4:44777] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x62560554 to 127.0.0.1:58010 2023-07-20 07:13:10,878 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-07-20 07:13:10,878 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1689837023706.37013e44b8b1510f4bef8010666ea4e1. 2023-07-20 07:13:10,879 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1689837023706.37013e44b8b1510f4bef8010666ea4e1. 2023-07-20 07:13:10,879 DEBUG [RS:0;jenkins-hbase4:44777] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-20 07:13:10,879 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1689837023706.37013e44b8b1510f4bef8010666ea4e1. after waiting 0 ms 2023-07-20 07:13:10,879 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1689837023706.37013e44b8b1510f4bef8010666ea4e1. 2023-07-20 07:13:10,879 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 37013e44b8b1510f4bef8010666ea4e1 1/1 column families, dataSize=78 B heapSize=488 B 2023-07-20 07:13:10,880 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing a99cc01e32f8591c1e330231bf41e07d, disabling compactions & flushes 2023-07-20 07:13:10,880 INFO [RS:1;jenkins-hbase4:45099] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-07-20 07:13:10,881 INFO [RS:1;jenkins-hbase4:45099] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-07-20 07:13:10,881 INFO [RS:1;jenkins-hbase4:45099] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-07-20 07:13:10,881 INFO [RS:1;jenkins-hbase4:45099] regionserver.HRegionServer(3305): Received CLOSE for 1588230740 2023-07-20 07:13:10,880 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:acl,,1689837024458.a99cc01e32f8591c1e330231bf41e07d. 2023-07-20 07:13:10,881 INFO [RS:0;jenkins-hbase4:44777] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,44777,1689837020621; all regions closed. 2023-07-20 07:13:10,881 INFO [RS:2;jenkins-hbase4:44955] regionserver.HRegionServer(1474): Waiting on 1 regions to close 2023-07-20 07:13:10,881 DEBUG [RS:2;jenkins-hbase4:44955] regionserver.HRegionServer(1478): Online Regions={a99cc01e32f8591c1e330231bf41e07d=hbase:acl,,1689837024458.a99cc01e32f8591c1e330231bf41e07d.} 2023-07-20 07:13:10,881 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:acl,,1689837024458.a99cc01e32f8591c1e330231bf41e07d. 2023-07-20 07:13:10,882 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:acl,,1689837024458.a99cc01e32f8591c1e330231bf41e07d. after waiting 0 ms 2023-07-20 07:13:10,882 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:acl,,1689837024458.a99cc01e32f8591c1e330231bf41e07d. 2023-07-20 07:13:10,882 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing a99cc01e32f8591c1e330231bf41e07d 1/1 column families, dataSize=914 B heapSize=2.17 KB 2023-07-20 07:13:10,882 DEBUG [RS:2;jenkins-hbase4:44955] regionserver.HRegionServer(1504): Waiting on a99cc01e32f8591c1e330231bf41e07d 2023-07-20 07:13:10,883 INFO [RS:1;jenkins-hbase4:45099] regionserver.HRegionServer(1474): Waiting on 2 regions to close 2023-07-20 07:13:10,883 DEBUG [RS:1;jenkins-hbase4:45099] regionserver.HRegionServer(1478): Online Regions={1588230740=hbase:meta,,1.1588230740, 37013e44b8b1510f4bef8010666ea4e1=hbase:namespace,,1689837023706.37013e44b8b1510f4bef8010666ea4e1.} 2023-07-20 07:13:10,883 DEBUG [RS:1;jenkins-hbase4:45099] regionserver.HRegionServer(1504): Waiting on 1588230740, 37013e44b8b1510f4bef8010666ea4e1 2023-07-20 07:13:10,888 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-07-20 07:13:10,888 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-07-20 07:13:10,888 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-07-20 07:13:10,888 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-07-20 07:13:10,888 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-07-20 07:13:10,888 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 1588230740 3/3 column families, dataSize=45.93 KB heapSize=71.92 KB 2023-07-20 07:13:10,895 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-07-20 07:13:10,924 DEBUG [RS:0;jenkins-hbase4:44777] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/oldWALs 2023-07-20 07:13:10,924 INFO [RS:0;jenkins-hbase4:44777] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C44777%2C1689837020621:(num 1689837022975) 2023-07-20 07:13:10,924 DEBUG [RS:0;jenkins-hbase4:44777] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-20 07:13:10,924 INFO [RS:0;jenkins-hbase4:44777] regionserver.LeaseManager(133): Closed leases 2023-07-20 07:13:10,935 INFO [RS:0;jenkins-hbase4:44777] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-07-20 07:13:10,936 INFO [RS:0;jenkins-hbase4:44777] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-07-20 07:13:10,936 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-20 07:13:10,936 INFO [RS:0;jenkins-hbase4:44777] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-07-20 07:13:10,936 INFO [RS:0;jenkins-hbase4:44777] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-07-20 07:13:10,944 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/data/hbase/namespace/37013e44b8b1510f4bef8010666ea4e1/.tmp/info/1f5dd650c7bf44c08800d93918e3961b 2023-07-20 07:13:10,948 INFO [RS:0;jenkins-hbase4:44777] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:44777 2023-07-20 07:13:10,952 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=914 B at sequenceid=18 (bloomFilter=false), to=hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/data/hbase/acl/a99cc01e32f8591c1e330231bf41e07d/.tmp/l/2dc5a1fc65604deb9847e77a42486b94 2023-07-20 07:13:10,952 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=40.45 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/data/hbase/meta/1588230740/.tmp/info/bee9d5e9240848f5b4212e859086a6fe 2023-07-20 07:13:10,957 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): regionserver:44777-0x10181911f0f0001, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,44777,1689837020621 2023-07-20 07:13:10,957 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): regionserver:44955-0x10181911f0f0003, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,44777,1689837020621 2023-07-20 07:13:10,957 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): regionserver:44777-0x10181911f0f0001, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-20 07:13:10,957 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): master:37415-0x10181911f0f0000, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-20 07:13:10,957 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): regionserver:45099-0x10181911f0f0002, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,44777,1689837020621 2023-07-20 07:13:10,957 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): regionserver:45099-0x10181911f0f0002, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-20 07:13:10,957 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): regionserver:44955-0x10181911f0f0003, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-20 07:13:10,958 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,44777,1689837020621] 2023-07-20 07:13:10,959 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,44777,1689837020621; numProcessing=1 2023-07-20 07:13:10,961 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,44777,1689837020621 already deleted, retry=false 2023-07-20 07:13:10,961 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,44777,1689837020621 expired; onlineServers=2 2023-07-20 07:13:10,967 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-07-20 07:13:10,990 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-07-20 07:13:10,993 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 2dc5a1fc65604deb9847e77a42486b94 2023-07-20 07:13:10,995 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/data/hbase/acl/a99cc01e32f8591c1e330231bf41e07d/.tmp/l/2dc5a1fc65604deb9847e77a42486b94 as hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/data/hbase/acl/a99cc01e32f8591c1e330231bf41e07d/l/2dc5a1fc65604deb9847e77a42486b94 2023-07-20 07:13:10,996 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for bee9d5e9240848f5b4212e859086a6fe 2023-07-20 07:13:11,000 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/data/hbase/namespace/37013e44b8b1510f4bef8010666ea4e1/.tmp/info/1f5dd650c7bf44c08800d93918e3961b as hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/data/hbase/namespace/37013e44b8b1510f4bef8010666ea4e1/info/1f5dd650c7bf44c08800d93918e3961b 2023-07-20 07:13:11,001 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 2dc5a1fc65604deb9847e77a42486b94 2023-07-20 07:13:11,001 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/data/hbase/acl/a99cc01e32f8591c1e330231bf41e07d/l/2dc5a1fc65604deb9847e77a42486b94, entries=7, sequenceid=18, filesize=5.2 K 2023-07-20 07:13:11,004 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~914 B/914, heapSize ~2.16 KB/2208, currentSize=0 B/0 for a99cc01e32f8591c1e330231bf41e07d in 122ms, sequenceid=18, compaction requested=false 2023-07-20 07:13:11,027 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/data/hbase/namespace/37013e44b8b1510f4bef8010666ea4e1/info/1f5dd650c7bf44c08800d93918e3961b, entries=2, sequenceid=6, filesize=4.8 K 2023-07-20 07:13:11,029 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for 37013e44b8b1510f4bef8010666ea4e1 in 150ms, sequenceid=6, compaction requested=false 2023-07-20 07:13:11,032 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/data/hbase/acl/a99cc01e32f8591c1e330231bf41e07d/recovered.edits/21.seqid, newMaxSeqId=21, maxSeqId=1 2023-07-20 07:13:11,033 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-20 07:13:11,034 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:acl,,1689837024458.a99cc01e32f8591c1e330231bf41e07d. 2023-07-20 07:13:11,034 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for a99cc01e32f8591c1e330231bf41e07d: 2023-07-20 07:13:11,034 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:acl,,1689837024458.a99cc01e32f8591c1e330231bf41e07d. 2023-07-20 07:13:11,055 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=1.50 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/data/hbase/meta/1588230740/.tmp/rep_barrier/1261a449be2b4220b7390cabd7289a55 2023-07-20 07:13:11,055 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/data/hbase/namespace/37013e44b8b1510f4bef8010666ea4e1/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-20 07:13:11,056 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-20 07:13:11,057 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:namespace,,1689837023706.37013e44b8b1510f4bef8010666ea4e1. 2023-07-20 07:13:11,057 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 37013e44b8b1510f4bef8010666ea4e1: 2023-07-20 07:13:11,057 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1689837023706.37013e44b8b1510f4bef8010666ea4e1. 2023-07-20 07:13:11,059 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): regionserver:44777-0x10181911f0f0001, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-20 07:13:11,059 INFO [RS:0;jenkins-hbase4:44777] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,44777,1689837020621; zookeeper connection closed. 2023-07-20 07:13:11,060 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): regionserver:44777-0x10181911f0f0001, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-20 07:13:11,061 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 1261a449be2b4220b7390cabd7289a55 2023-07-20 07:13:11,067 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@5a3ee219] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@5a3ee219 2023-07-20 07:13:11,082 INFO [RS:2;jenkins-hbase4:44955] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,44955,1689837020792; all regions closed. 2023-07-20 07:13:11,083 DEBUG [RS:1;jenkins-hbase4:45099] regionserver.HRegionServer(1504): Waiting on 1588230740 2023-07-20 07:13:11,087 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.98 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/data/hbase/meta/1588230740/.tmp/table/696ddf22f9ab47a4a9b077d50a81a37c 2023-07-20 07:13:11,099 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 696ddf22f9ab47a4a9b077d50a81a37c 2023-07-20 07:13:11,100 DEBUG [RS:2;jenkins-hbase4:44955] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/oldWALs 2023-07-20 07:13:11,100 INFO [RS:2;jenkins-hbase4:44955] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C44955%2C1689837020792:(num 1689837022940) 2023-07-20 07:13:11,100 DEBUG [RS:2;jenkins-hbase4:44955] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-20 07:13:11,100 INFO [RS:2;jenkins-hbase4:44955] regionserver.LeaseManager(133): Closed leases 2023-07-20 07:13:11,101 INFO [RS:2;jenkins-hbase4:44955] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-07-20 07:13:11,104 INFO [RS:2;jenkins-hbase4:44955] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-07-20 07:13:11,104 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-20 07:13:11,104 INFO [RS:2;jenkins-hbase4:44955] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-07-20 07:13:11,104 INFO [RS:2;jenkins-hbase4:44955] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-07-20 07:13:11,105 INFO [RS:2;jenkins-hbase4:44955] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:44955 2023-07-20 07:13:11,105 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/data/hbase/meta/1588230740/.tmp/info/bee9d5e9240848f5b4212e859086a6fe as hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/data/hbase/meta/1588230740/info/bee9d5e9240848f5b4212e859086a6fe 2023-07-20 07:13:11,107 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): regionserver:45099-0x10181911f0f0002, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,44955,1689837020792 2023-07-20 07:13:11,107 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): regionserver:44955-0x10181911f0f0003, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,44955,1689837020792 2023-07-20 07:13:11,107 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): master:37415-0x10181911f0f0000, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-20 07:13:11,110 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,44955,1689837020792] 2023-07-20 07:13:11,110 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,44955,1689837020792; numProcessing=2 2023-07-20 07:13:11,111 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,44955,1689837020792 already deleted, retry=false 2023-07-20 07:13:11,111 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for bee9d5e9240848f5b4212e859086a6fe 2023-07-20 07:13:11,111 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,44955,1689837020792 expired; onlineServers=1 2023-07-20 07:13:11,111 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/data/hbase/meta/1588230740/info/bee9d5e9240848f5b4212e859086a6fe, entries=48, sequenceid=131, filesize=10.3 K 2023-07-20 07:13:11,112 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/data/hbase/meta/1588230740/.tmp/rep_barrier/1261a449be2b4220b7390cabd7289a55 as hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/data/hbase/meta/1588230740/rep_barrier/1261a449be2b4220b7390cabd7289a55 2023-07-20 07:13:11,118 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 1261a449be2b4220b7390cabd7289a55 2023-07-20 07:13:11,118 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/data/hbase/meta/1588230740/rep_barrier/1261a449be2b4220b7390cabd7289a55, entries=13, sequenceid=131, filesize=6.4 K 2023-07-20 07:13:11,119 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/data/hbase/meta/1588230740/.tmp/table/696ddf22f9ab47a4a9b077d50a81a37c as hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/data/hbase/meta/1588230740/table/696ddf22f9ab47a4a9b077d50a81a37c 2023-07-20 07:13:11,123 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 696ddf22f9ab47a4a9b077d50a81a37c 2023-07-20 07:13:11,124 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/data/hbase/meta/1588230740/table/696ddf22f9ab47a4a9b077d50a81a37c, entries=24, sequenceid=131, filesize=6.9 K 2023-07-20 07:13:11,124 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~45.93 KB/47028, heapSize ~71.88 KB/73600, currentSize=0 B/0 for 1588230740 in 236ms, sequenceid=131, compaction requested=false 2023-07-20 07:13:11,139 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/data/hbase/meta/1588230740/recovered.edits/134.seqid, newMaxSeqId=134, maxSeqId=1 2023-07-20 07:13:11,139 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-20 07:13:11,140 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-07-20 07:13:11,140 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-07-20 07:13:11,140 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-07-20 07:13:11,140 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-07-20 07:13:11,210 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): regionserver:44955-0x10181911f0f0003, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-20 07:13:11,210 INFO [RS:2;jenkins-hbase4:44955] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,44955,1689837020792; zookeeper connection closed. 2023-07-20 07:13:11,210 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): regionserver:44955-0x10181911f0f0003, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-20 07:13:11,210 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@5662f18f] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@5662f18f 2023-07-20 07:13:11,283 INFO [RS:1;jenkins-hbase4:45099] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,45099,1689837020733; all regions closed. 2023-07-20 07:13:11,293 DEBUG [RS:1;jenkins-hbase4:45099] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/oldWALs 2023-07-20 07:13:11,293 INFO [RS:1;jenkins-hbase4:45099] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C45099%2C1689837020733.meta:.meta(num 1689837023275) 2023-07-20 07:13:11,308 DEBUG [RS:1;jenkins-hbase4:45099] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/oldWALs 2023-07-20 07:13:11,308 INFO [RS:1;jenkins-hbase4:45099] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C45099%2C1689837020733:(num 1689837022943) 2023-07-20 07:13:11,308 DEBUG [RS:1;jenkins-hbase4:45099] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-20 07:13:11,308 INFO [RS:1;jenkins-hbase4:45099] regionserver.LeaseManager(133): Closed leases 2023-07-20 07:13:11,309 INFO [RS:1;jenkins-hbase4:45099] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-07-20 07:13:11,309 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-20 07:13:11,310 INFO [RS:1;jenkins-hbase4:45099] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:45099 2023-07-20 07:13:11,312 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): regionserver:45099-0x10181911f0f0002, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,45099,1689837020733 2023-07-20 07:13:11,312 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): master:37415-0x10181911f0f0000, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-20 07:13:11,313 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,45099,1689837020733] 2023-07-20 07:13:11,313 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,45099,1689837020733; numProcessing=3 2023-07-20 07:13:11,316 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,45099,1689837020733 already deleted, retry=false 2023-07-20 07:13:11,316 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,45099,1689837020733 expired; onlineServers=0 2023-07-20 07:13:11,316 INFO [RegionServerTracker-0] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,37415,1689837019114' ***** 2023-07-20 07:13:11,316 INFO [RegionServerTracker-0] regionserver.HRegionServer(2311): STOPPED: Cluster shutdown set; onlineServer=0 2023-07-20 07:13:11,316 DEBUG [M:0;jenkins-hbase4:37415] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@43d5bc9, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-07-20 07:13:11,316 INFO [M:0;jenkins-hbase4:37415] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,37415,1689837019114 2023-07-20 07:13:11,316 INFO [M:0;jenkins-hbase4:37415] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,37415,1689837019114; all regions closed. 2023-07-20 07:13:11,316 DEBUG [M:0;jenkins-hbase4:37415] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-20 07:13:11,316 DEBUG [M:0;jenkins-hbase4:37415] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-07-20 07:13:11,317 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-07-20 07:13:11,317 DEBUG [M:0;jenkins-hbase4:37415] cleaner.HFileCleaner(317): Stopping file delete threads 2023-07-20 07:13:11,317 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1689837022465] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1689837022465,5,FailOnTimeoutGroup] 2023-07-20 07:13:11,317 INFO [M:0;jenkins-hbase4:37415] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-07-20 07:13:11,317 INFO [M:0;jenkins-hbase4:37415] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-07-20 07:13:11,317 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1689837022466] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1689837022466,5,FailOnTimeoutGroup] 2023-07-20 07:13:11,317 INFO [M:0;jenkins-hbase4:37415] hbase.ChoreService(369): Chore service for: master/jenkins-hbase4:0 had [] on shutdown 2023-07-20 07:13:11,317 DEBUG [M:0;jenkins-hbase4:37415] master.HMaster(1512): Stopping service threads 2023-07-20 07:13:11,317 INFO [M:0;jenkins-hbase4:37415] procedure2.RemoteProcedureDispatcher(119): Stopping procedure remote dispatcher 2023-07-20 07:13:11,318 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): master:37415-0x10181911f0f0000, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-07-20 07:13:11,318 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): master:37415-0x10181911f0f0000, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-20 07:13:11,318 ERROR [M:0;jenkins-hbase4:37415] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] Thread[HFileArchiver-22,5,PEWorkerGroup] Thread[HFileArchiver-23,5,PEWorkerGroup] 2023-07-20 07:13:11,318 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:37415-0x10181911f0f0000, quorum=127.0.0.1:58010, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-20 07:13:11,319 INFO [M:0;jenkins-hbase4:37415] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-07-20 07:13:11,319 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-07-20 07:13:11,319 DEBUG [M:0;jenkins-hbase4:37415] zookeeper.ZKUtil(398): master:37415-0x10181911f0f0000, quorum=127.0.0.1:58010, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-07-20 07:13:11,319 WARN [M:0;jenkins-hbase4:37415] master.ActiveMasterManager(326): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-07-20 07:13:11,319 INFO [M:0;jenkins-hbase4:37415] assignment.AssignmentManager(315): Stopping assignment manager 2023-07-20 07:13:11,320 INFO [M:0;jenkins-hbase4:37415] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-07-20 07:13:11,321 DEBUG [M:0;jenkins-hbase4:37415] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-07-20 07:13:11,321 INFO [M:0;jenkins-hbase4:37415] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-20 07:13:11,321 DEBUG [M:0;jenkins-hbase4:37415] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-20 07:13:11,321 DEBUG [M:0;jenkins-hbase4:37415] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-07-20 07:13:11,321 DEBUG [M:0;jenkins-hbase4:37415] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-20 07:13:11,321 INFO [M:0;jenkins-hbase4:37415] regionserver.HRegion(2745): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=375.89 KB heapSize=452.13 KB 2023-07-20 07:13:11,345 INFO [M:0;jenkins-hbase4:37415] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=375.89 KB at sequenceid=899 (bloomFilter=true), to=hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/c73f421a883946a999bf192d37523334 2023-07-20 07:13:11,349 INFO [M:0;jenkins-hbase4:37415] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c73f421a883946a999bf192d37523334 2023-07-20 07:13:11,350 DEBUG [M:0;jenkins-hbase4:37415] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/c73f421a883946a999bf192d37523334 as hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/c73f421a883946a999bf192d37523334 2023-07-20 07:13:11,355 INFO [M:0;jenkins-hbase4:37415] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c73f421a883946a999bf192d37523334 2023-07-20 07:13:11,355 INFO [M:0;jenkins-hbase4:37415] regionserver.HStore(1080): Added hdfs://localhost:39649/user/jenkins/test-data/aa1ead6b-8ad5-0541-2db6-428dfc85962b/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/c73f421a883946a999bf192d37523334, entries=119, sequenceid=899, filesize=28.7 K 2023-07-20 07:13:11,356 INFO [M:0;jenkins-hbase4:37415] regionserver.HRegion(2948): Finished flush of dataSize ~375.89 KB/384915, heapSize ~452.12 KB/462968, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 35ms, sequenceid=899, compaction requested=false 2023-07-20 07:13:11,363 INFO [M:0;jenkins-hbase4:37415] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-20 07:13:11,363 DEBUG [M:0;jenkins-hbase4:37415] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-20 07:13:11,369 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-20 07:13:11,369 INFO [M:0;jenkins-hbase4:37415] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-07-20 07:13:11,370 INFO [M:0;jenkins-hbase4:37415] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:37415 2023-07-20 07:13:11,377 DEBUG [M:0;jenkins-hbase4:37415] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase4.apache.org,37415,1689837019114 already deleted, retry=false 2023-07-20 07:13:11,413 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): regionserver:45099-0x10181911f0f0002, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-20 07:13:11,413 INFO [RS:1;jenkins-hbase4:45099] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,45099,1689837020733; zookeeper connection closed. 2023-07-20 07:13:11,413 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): regionserver:45099-0x10181911f0f0002, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-20 07:13:11,413 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@461748d0] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@461748d0 2023-07-20 07:13:11,414 INFO [Listener at jenkins-hbase4.apache.org/33837] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 3 regionserver(s) complete 2023-07-20 07:13:11,513 INFO [M:0;jenkins-hbase4:37415] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,37415,1689837019114; zookeeper connection closed. 2023-07-20 07:13:11,513 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): master:37415-0x10181911f0f0000, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-20 07:13:11,513 DEBUG [Listener at localhost/46569-EventThread] zookeeper.ZKWatcher(600): master:37415-0x10181911f0f0000, quorum=127.0.0.1:58010, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-20 07:13:11,516 WARN [Listener at jenkins-hbase4.apache.org/33837] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-07-20 07:13:11,532 INFO [Listener at jenkins-hbase4.apache.org/33837] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-20 07:13:11,636 WARN [BP-1926178388-172.31.14.131-1689837014917 heartbeating to localhost/127.0.0.1:39649] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-07-20 07:13:11,637 WARN [BP-1926178388-172.31.14.131-1689837014917 heartbeating to localhost/127.0.0.1:39649] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1926178388-172.31.14.131-1689837014917 (Datanode Uuid 21c8528f-545a-4035-ac09-1bc5b0c4d66f) service to localhost/127.0.0.1:39649 2023-07-20 07:13:11,639 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c07d5e8c-eba2-0ae8-aa3a-b7afa648e7e7/cluster_fb56fef8-ff82-388f-e012-71bf1b21f2d0/dfs/data/data5/current/BP-1926178388-172.31.14.131-1689837014917] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-20 07:13:11,639 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c07d5e8c-eba2-0ae8-aa3a-b7afa648e7e7/cluster_fb56fef8-ff82-388f-e012-71bf1b21f2d0/dfs/data/data6/current/BP-1926178388-172.31.14.131-1689837014917] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-20 07:13:11,641 WARN [Listener at jenkins-hbase4.apache.org/33837] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-07-20 07:13:11,649 INFO [Listener at jenkins-hbase4.apache.org/33837] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-20 07:13:11,670 WARN [BP-1926178388-172.31.14.131-1689837014917 heartbeating to localhost/127.0.0.1:39649] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1926178388-172.31.14.131-1689837014917 (Datanode Uuid 1aec689a-a5a9-446f-8ab1-c2a66c0682fb) service to localhost/127.0.0.1:39649 2023-07-20 07:13:11,671 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c07d5e8c-eba2-0ae8-aa3a-b7afa648e7e7/cluster_fb56fef8-ff82-388f-e012-71bf1b21f2d0/dfs/data/data3/current/BP-1926178388-172.31.14.131-1689837014917] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-20 07:13:11,671 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c07d5e8c-eba2-0ae8-aa3a-b7afa648e7e7/cluster_fb56fef8-ff82-388f-e012-71bf1b21f2d0/dfs/data/data4/current/BP-1926178388-172.31.14.131-1689837014917] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-20 07:13:11,754 WARN [Listener at jenkins-hbase4.apache.org/33837] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-07-20 07:13:11,756 INFO [Listener at jenkins-hbase4.apache.org/33837] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-20 07:13:11,860 WARN [BP-1926178388-172.31.14.131-1689837014917 heartbeating to localhost/127.0.0.1:39649] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-07-20 07:13:11,860 WARN [BP-1926178388-172.31.14.131-1689837014917 heartbeating to localhost/127.0.0.1:39649] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1926178388-172.31.14.131-1689837014917 (Datanode Uuid ba9ccf6a-a63d-4d9f-b6fc-a38b3df7e48a) service to localhost/127.0.0.1:39649 2023-07-20 07:13:11,861 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c07d5e8c-eba2-0ae8-aa3a-b7afa648e7e7/cluster_fb56fef8-ff82-388f-e012-71bf1b21f2d0/dfs/data/data1/current/BP-1926178388-172.31.14.131-1689837014917] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-20 07:13:11,861 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c07d5e8c-eba2-0ae8-aa3a-b7afa648e7e7/cluster_fb56fef8-ff82-388f-e012-71bf1b21f2d0/dfs/data/data2/current/BP-1926178388-172.31.14.131-1689837014917] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-20 07:13:11,889 INFO [Listener at jenkins-hbase4.apache.org/33837] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-20 07:13:12,016 INFO [Listener at jenkins-hbase4.apache.org/33837] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-07-20 07:13:12,108 INFO [Listener at jenkins-hbase4.apache.org/33837] hbase.HBaseTestingUtility(1293): Minicluster is down